← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGradientHQ/parallax

parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

73.8/100
★ 1.3KForks: 138
View on GitHub →
Loading report...

Similar Projects

kvpress

79

LLM KV cache compression made easy

Python★ 1.1K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 82.4K

LlamaFactory

92

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Python★ 72.0K

langextract

86

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Python★ 36.8K
← Back to List