Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGeeeekExplorer/nano-vllm

nano-vllm

Nano vLLM

59.2/100
14.0KForks: 2.2K
View on GitHub
Loading report...

Similar Projects

text-generation-inference

72

Large Language Model Text Generation Inference

Python10.9K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python82.4K

llm-foundry

73

LLM training code for Databricks foundation models

Python4.4K

keras-hub

78

Pretrained model hub for Keras 3.

Python985
Back to List