← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++nndeploy/nndeploy

nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

78.2/100
★ 1.9KForks: 233
View on GitHub →Homepage →
Loading report...

Similar Projects

MNN

88

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++★ 16.0K

deeplake

75

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

C++★ 9.2K

cactus

83

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

C++★ 6.0K

vllm-ascend

79

Community maintained hardware plugin for vLLM on Ascend

C++★ 2.8K
← Back to List