LiteLLM

LiteLLM is an open-source Python library and proxy server that provides a unified API to interact with over 100 large language model (LLM) providers. It abstracts different providers' APIs into a consistent OpenAI API-like format, allowing developers to switch models or providers with minimal code changes and manage multiple deployments with retries, fallbacks, and cost tracking.