← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonskyzh/tiny-llm

tiny-llm

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

73.9/100
★ 4.8KForks: 403
View on GitHub →Homepage →
Loading report...

Similar Projects

UltraRAG

86

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python★ 5.7K

Rapid-MLX

87

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server and Mac app for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Release-gated with Claude Code, Codex CLI, Aider, Hermes and DeepSeek Harness.

Python★ 3.9K

FastDeploy

82

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Python★ 3.7K

parallax

58

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python★ 1.4K
← Back to List