Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Goenvoyproxy/ai-gateway

ai-gateway

Manages Unified Access to Generative AI Services built on Envoy Gateway

82.0/100
1.5KForks: 225
View on GitHubHomepage →
Loading report...

Similar Projects

aikit

80

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Go518

axonhub

86

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

Go3.3K

trainer

88

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Go2.1K

kubeai

77

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Go1.2K
Back to List