sglang

A high-throughput and memory-efficient inference and serving engine for LLMs

A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

open-source healthcare ai

Web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.