LiteLLM icon

LiteLLM

Open-source proxy and SDK providing unified API access to 100+ LLM providers with routing, caching, and observability.

Visit Website Agent Runtimes & Platforms
runtime infrastructure open-source gateway

Overview

Open-source proxy and SDK providing unified API access to 100+ LLM providers with routing, caching, and observability.

Details

LiteLLM is an open-source proxy and SDK providing unified API access to 100+ LLM providers (OpenAI, Anthropic, Google, AWS, Azure, OSS models) through a single OpenAI-compatible interface. LiteLLM handles routing, fallbacks, caching, rate limiting, and observability for production LLM applications. LiteLLM is one of the most-used LLM gateway tools.

Tags

runtime, infrastructure, open-source, gateway

Back to Agents