# SGLang

- **Website:** <https://sglang.io>
- **Primary alias:** `sglang.io`

## Description

SGLang is an open-source serving framework for fast, scalable inference with large language and multimodal models. It is designed for both experimentation and large-scale production deployments, aiming to deliver reliable, low-latency, high-throughput performance from a single accelerator to distributed clusters. The framework supports language, vision-language, and diffusion models, enabling text generation, multimodal understanding, and image and video generation across a range of hardware platforms.

SGLang’s capabilities include disaggregated prefill and decode, speculative decoding, multiple parallelism strategies, a scheduler designed to minimize overhead, and optimized GPU kernels. Users can install it through pip or Docker, launch a model server with a command, and interact through OpenAI-compatible API endpoints. Supported platforms include NVIDIA and AMD GPUs, Google TPUs, CPUs, Ascend NPUs, and XPU; the project also lists models such as DeepSeek, Qwen, GPT-OSS, Llama, Mistral, and GLM. SGLang publishes regular releases, documentation, and community updates, and hosts events including the SGLang Summit. Its development reflects contributions from a broad open-source community.

## Industries

- 🖥 Computers Electronics and Technology
- 🖥 Artificial Intelligence and Machine Learning _(under Computers Electronics and Technology)_

## Links

- [github](https://github.com/sgl-project)
- [linkedin](https://linkedin.com/company/sgl-project)
- [twitter](https://twitter.com/sgl_project)

## Logos & icons

- logo _(primary)_ — PNG — [download](https://cdn.brandfetch.io/idm7iqMWdS/w/2392/h/728/theme/dark/logo.png?c=1bxid64Mup7aczewSAYMX&t=1792614465775)
- icon _(primary)_ — JPEG — [download](https://cdn.brandfetch.io/idm7iqMWdS/w/400/h/400/theme/dark/icon.jpeg?c=1bxid64Mup7aczewSAYMX&t=1792614465879)

## Colors

| Name | Hex | Theme |
| --- | --- | --- |
| Orange Roughy | #d55815 | accent |
| Port Gore | #202647 | dark |
| Bridal Heath | #fff9f0 | light |

## Fonts

- Inter — asset _(google)_
- Inter — asset _(google)_

---

_Source: <https://brandfetch.com/sglang.io>_
_See [/llms.txt](/llms.txt) for a full list of agent-readable pages, and [/auth.md](/auth.md) for how agents authenticate._