Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++ggml-org/llama.cpp

llama.cpp

LLM inference in C/C++

84.6/100
97.2KForks: 15.3K
View on GitHub
Loading report...

Similar Projects

whisper.cpp

85

Port of OpenAI's Whisper model in C/C++

C++47.3K

rocksdb

88

A library that provides an embeddable, persistent key-value store for fast storage.

C++31.6K

xiaozhi-esp32

87

An MCP-based chatbot | 一个基于MCP的聊天机器人

C++24.5K

yoga

87

Yoga is an embeddable layout engine targeting web standards.

C++18.7K
Back to List