Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGeeeekExplorer/nano-vllm

nano-vllm

Nano vLLM

54.2/100
14.6KForks: 2.4K
View on GitHub
Loading report...

Similar Projects

text-generation-inference

69

Large Language Model Text Generation Inference

Python10.9K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python87.1K

llm-foundry

67

LLM training code for Databricks foundation models

Python4.4K

keras-hub

80

Pretrained model hub for Keras 3.

Python986
Back to List