Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++PaddlePaddle/Serving

Serving

A flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)

59.9/100
923Forks: 245
View on GitHub
Loading report...

Similar Projects

serving

92

A flexible, high-performance serving system for machine learning models

C++6.4K

model_server

85

A scalable inference server for models optimized with OpenVINO™

C++905

FinceptTerminal

91

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

C++29.0K

MNN

89

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++15.7K
Back to List