Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonthu-pacman/chitu
chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.