VLvLLM
High-throughput, memory-efficient inference and serving engine for large language models.
Open-source projects by this author in the catalog, across all categories and statuses.
3 Projects
VLHigh-throughput, memory-efficient inference and serving engine for large language models.
VLA reference system for Kubernetes-native cluster deployment and community-driven performance optimization for vLLM.
VLA framework for high-performance, cost-efficient inference and serving of omni-modality models across text, image, video, and audio.