Back to Tools Directory

litellm

Litellm is a Python SDK that serves as a proxy server, allowing users to access over 100 language model APIs in a unified format. It includes features for cost tracking, load balancing, and logging, making it easier for developers to integrate AI capabilities into their applications.

Categories & Topics

LLM

Repository Stats

36k
GitHub Stars

Related Tools