LiteLLM
Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.
✨ Try AgentScout's free AI image generator →Good for: building AI agents, building voice agents, connecting tools with MCP, monitoring agents in production, agent security and safety
Use cases
About LiteLLM
LiteLLM is listed in our MCP & infra category and is aimed at builders. Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging. Pricing, as the maker states it: Open source + cloud. Maturity: Mature. We last checked the official link on 2026-10-18.
LiteLLM ratings and reviews
LiteLLM alternatives
Compare 10 LiteLLM alternatives side by side →
Other MCP & infra tools in our directory. See all MCP & infra tools →
Open Connector
Open-source auth gateway connecting SaaS apps to AI agents via SDK, CLI and MCP.
Kong Gateway
Cloud-native API, LLM and MCP gateway that adds routing, auth, multi-LLM support, semantic security and MCP traffic analytics through plugins.
Bifrost
High-performance AI gateway from Maxim that unifies 20+ LLM providers behind one OpenAI-compatible API and acts as an MCP and agent gateway.
optillm
Inference proxy that applies reasoning techniques to improve LLM answers.
Portkey AI Gateway
Fast open-source AI gateway that routes requests to hundreds of LLMs through one API with fallbacks, load balancing and built-in guardrails.
Agent Vault
Infisical's open-source credential broker that proxies API calls for AI agents so they never hold secrets themselves.
Popular searches with this tool
🏆 Ranked in: HyperFrames alternatives · Kong Gateway alternatives
💲 Estimate API cost: compare per-request and monthly costs for GPT, Claude, Gemini and Grok models.
Badge for makers
Built LiteLLM? Add this badge to your README or site. It links back to this page. About badges
