LiteLLM

Unified interface for 100+ LLM APIs

LLM Utility Free (OSS)
Visit Official Site →

What It Is

LiteLLM provides a single OpenAI-compatible interface over 100+ LLM providers (OpenAI, Anthropic, Google, Cohere, local, and more). Drop-in replacement for the openai SDK. Also includes a proxy mode for caching, rate limiting, and cost tracking.

Strengths & Weaknesses

✓ Strengths

  • Unified API
  • 100+ providers
  • OpenAI-compatible
  • Proxy with caching

× Weaknesses

  • Abstraction limits provider-specific features
  • Extra dependency
  • Occasional version drift

Best Use Cases

Multi-provider appsProvider switchingCost optimization

Alternatives

OpenRouter
Single API for all LLM providers
← Back to AI Tools Database