sgl-project

Pinned Loading

1. sglang sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 32.3k 8.1k

2. SpecForge SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 1.1k 320

3. sglang-omni sglang-omni Public

   SGLang-Omni empowers high-performance serving for TTS, ASR, speech and omni models.

   Python 919 368

4. mini-sglang mini-sglang Public

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python 4.8k 800

5. sglang-jax sglang-jax Public

   JAX backend for SGL

   Python 344 129