vLLM Project

Open-source projects by this author in the catalog, across all categories and statuses.

3 Projects

vLLM

High-throughput, memory-efficient inference and serving engine for large language models.

Stars --Last Commit --

vLLM Production Stack

A reference system for Kubernetes-native cluster deployment and community-driven performance optimization for vLLM.

Stars --Last Commit --

vLLM-Omni

A framework for high-performance, cost-efficient inference and serving of omni-modality models across text, image, video, and audio.

Stars --Last Commit --