KIKinference
An inference control plane for Kubernetes and vLLM that selects among inference endpoints while applying policies, routing, and load balancing. It monitors vLLM KV-cache events and engine metrics to make placement decisions.
Kinference-AI (Buoyant)
Open-source projects by this author in the catalog, across all categories and statuses.
1 Projects
KI