Search. Pull. Build.

llm-d Router components — the Endpoint Picker (EPP) ext-proc endpoint selector, the prefill/decode disaggregation sidecar, and the request coordinator — for cache- and load-aware routing of LLM inference traffic.

llm-d Router components — the Endpoint Picker (EPP) ext-proc endpoint selector, the prefill/decode disaggregation sidecar, and the request coordinator — for cache- and load-aware routing of LLM inference traffic.

Kubernetes operator for the vLLM Production Stack, vLLM's reference system for K8S-native cluster-wide deployment, that manages LoRA adapters, vLLM runtimes, routers and cache servers through CRDs.

Local Path Provisioner provides a way for the Kubernetes users to utilize the local storage in each node.

Helm chart for deploying local-static-provisioner.

The local volume node cleanup controller removes PersistentVolumes and PersistentVolumeClaims that reference deleted Nodes.

Static provisioner of local volumes