Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Rusttrymirai/uzu

uzu

A high-performance inference engine for AI models

71.9/100
1.6KForks: 49
View on GitHubHomepage →
Loading report...

Similar Projects

tensorzero

89

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Rust11.3K

meetily

78

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.

Rust11.2K

aichat

74

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Rust9.9K

rig

89

⚙️🦀 Build modular and scalable LLM Applications in Rust

Rust7.0K
Back to List