Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
SwiftSharpAI/SwiftLM

SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

78.5/100
760Forks: 53
View on GitHub
Loading report...

Similar Projects

turbo-fieldfare

81

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Swift6.7K

osaurus

89

Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.

Swift7.8K

enchanted

70

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Swift6.0K

Klee

48

A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

Swift1.8K
Back to List