Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++PaddlePaddle/Serving

Serving

A flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)

61.5/100
919Forks: 246
View on GitHub
Loading report...

Similar Projects

serving

92

A flexible, high-performance serving system for machine learning models

C++6.4K

model_server

85

A scalable inference server for models optimized with OpenVINO™

C++888

FinceptTerminal

91

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

C++26.2K

MNN

93

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++15.5K
Back to List