SGLang: From Frontend DSL to the SRT Serving Runtime
SGLang: From Frontend DSL to the SRT Serving Runtime SGLang is an open-source serving framework for large language and multimodal models, developed under the LMSYS organization and published as sgl-project/sglang under the Apache-2.0 license. As of 2026-08-09 the repository has about 31.6k stars, and the latest release is v0.5.17 (2026-08-08). One sentence of framing matters more than any of these numbers: SGLang is two systems — a Python-embedded frontend language for writing “LLM programs,“ and a serving runtime originally called SRT (SGLang Runtime). Understanding the boundary between them explains both the project’s history and its current position among inference engines.