Search. Pull. Build.

A Kubernetes-native platform for serving machine learning models at scale

A Kubernetes-native platform for serving machine learning models at scale

A Kubernetes-native platform for serving machine learning models at scale

A Kubernetes-native platform for serving machine learning models at scale

A Kubernetes-native platform for serving machine learning models at scale

LiteLLM is a unified interface to call 100+ LLMs using the OpenAI format, providing a proxy server for multiple LLM providers.