← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonmadroidmaq/mlx-omni-server

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

64.5/100
★ 746Forks: 90
View on GitHub →Homepage →
Loading report...

Similar Projects

sgr-agent-core

77

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

Python★ 1.1K

bedrock-access-gateway

57

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Python★ 1.0K

gpt4free

94

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

Python★ 66.8K

omlx

89

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Python★ 22.5K
← Back to List