litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] Written mainly in Python.
What this is
LLM frameworks , Libraries for building your own application on top of a model: orchestration, agents, structured output and provider routing.
This entry describes litellm in its own words, taken from its own page. KuponGuru publishes no ratings or review scores, and claims no affiliate relationship with any tool listed.