← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonPaddlePaddle/FastDeploy

FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

84.4/100
★ 3.7KForks: 755
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 87.1K

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python★ 10.9K

UltraRAG

85

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python★ 5.7K

gpustack

84

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Python★ 5.4K
← Back to List