← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++tensorflow/serving

serving

A flexible, high-performance serving system for machine learning models

77.3/100
★ 6.3KForks: 2.2K
View on GitHub →Homepage →
Loading report...

Similar Projects

deeplake

86

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

C++★ 9.0K

MNN

94

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++★ 14.5K

Serving

74

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

C++★ 925

model_server

85

A scalable inference server for models optimized with OpenVINO™

C++★ 836
← Back to List