sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #39 of 1,950 repositories GStars tracks this week (top 2%).
5 releases in the last 90 days, the latest 11 days ago, with 449 contributors on GitHub.
The biggest single-day gain in the last year, +181 stars on Nov 7, coincided with release v0.5.5.
Use Cases & Benefits
- Provides a high-performance serving framework for large language and multimodal models with optimized backend runtime and flexible frontend language.
- Delivers faster and more controllable model interactions through advanced runtime optimizations like RadixAttention, zero-overhead scheduling, and multi-parallelism support.
- Use for deploying large-scale LLM inference pipelines requiring efficient GPU utilization and low-latency responses in production environments.
- Use for developing complex LLM applications with chained generation, advanced prompting, and multi-modal input handling via an intuitive frontend language.
- Use for integrating and serving diverse generative, embedding, and reward models with extensible support for new architectures and quantization techniques.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Learn more in the release blogs: v0.2 blog, v0.3 blog, v0.4 blog, Large-scale expert parallelism.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+6,511 stars over 85 days across 20 snapshot days; best day +105 on Sep 5.
Forks
9.5K+2.2K
Open issues
5.7K+1.2K
Compared with peers in LLM
Fastest-growing repositories GStars tracks in this cohort for the week of Oct 11, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| thedotmack/claude-mem | 100.4K | +3.6K | 75 | today |
| tashfeenahmed/freellmapi | 34.7K | +3.4K | 75 | today |
| JuliusBrussee/caveman | 111.0K | +1.6K | 75 | 3 days ago |
| p-e-w/heretic | 35.1K | +1.5K | 41 | 121 days ago |
| xerj-org/xerj | 3.8K | +1.2K | 75 | today |
| sgl-project/sglang | 37.1K | +0 | 64 | 11 days ago |
| Category median | 35.1K | +1.6K | 75 | — |
Also by sgl-project
Other repositories from this maintainer that GStars tracks
Discover Repositories
Search across tracked repositories by name or description