← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonvllm-project/llm-compressor

llm-compressor

State-of-the-art LLM compression, built for production inference with vLLM

85.2/100
★ 3.8KForks: 678
View on GitHub →Homepage →
Loading report...

Similar Projects

nncf

81

Neural Network Compression Framework for enhanced OpenVINO™ inference

Python★ 1.2K

LlamaFactory

90

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Python★ 75.3K

headroom

93

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Python★ 74.4K

faster-whisper

86

Faster Whisper transcription with CTranslate2

Python★ 25.7K
← Back to List