Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++ggml-org/llama.cpp

llama.cpp

LLM inference in C/C++

89.2/100
127.4KForks: 22.9K
View on GitHubHomepage →
Loading report...

Similar Projects

whisper.cpp

87

Port of OpenAI's Whisper model in C/C++

C++53.5K

BitNet

60

Official inference framework for 1-bit LLMs

C++40.2K

rocksdb

87

A library that provides an embeddable, persistent key-value store for fast storage.

C++32.1K

FinceptTerminal

91

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

C++31.2K
Back to List