SGsglang-omni
A multi-stage serving runtime for omni, speech, and TTS models from the SGLang project, designed for multi-stage decoding across heterogeneous stages and exposed through OpenAI-compatible endpoints.
Open-source projects by this author in the catalog, across all categories and statuses.
1 Projects
SGA multi-stage serving runtime for omni, speech, and TTS models from the SGLang project, designed for multi-stage decoding across heterogeneous stages and exposed through OpenAI-compatible endpoints.