Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonharleyszhang/llm_note

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

55.6/100
889Forks: 88
View on GitHub
Loading report...

Similar Projects

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python10.9K

litgpt

88

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python13.5K

OpenLLM

90

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python12.4K

lmdeploy

85

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python8.0K
Back to List