← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++kvcache-ai/Mooncake

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

87.3/100
★ 6.0KForks: 1.0K
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm-ascend

79

Community maintained hardware plugin for vLLM on Ascend

C++★ 2.5K

runanywhere-sdks

82

Production ready toolkit to run AI locally

C++★ 10.3K

tiny-vllm

61

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

C++★ 946

whisper.cpp

81

Port of OpenAI's Whisper model in C/C++

C++★ 52.3K
← Back to List