ai-toolkit/ai-interfaces/ai-workspaces/litellm
Amazon Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Hugging Face, Replicate, Groq
LiteLLM
www.litellm.aiLLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.