SOURCE REVIEWED / 2026-11-20
LiteLLM
Inspect gateway routing, provider adapters and streaming retry behavior.
Where it fits
See versioned upstream runtime and deployment requirements
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
License and practical limits
MIT core; enterprise directory separately licensed. Core license does not cover enterprise code. Provider credentials, hosted costs and deployment behavior require separate review.
Source reviewed; not independently installed or tested. No cloud service or hardware purchase is required to read the source.
Repository snapshot
63,608 stars and 13,444 forks when checked 2026-11-20. These numbers change and are not a security or quality endorsement.
Read the official repository ↗
Before you run it
Read installation requirements and release notes, verify the download source, and keep your own projects backed up. Review third-party plugins and model licenses separately.