sgl-project/mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #458 of 3,103 repositories GStars tracks this week (top 15%).
The project lists 36 contributors on GitHub.
Peaked at #76 in the weekly ranking the week of Dec 21, its best in the past year.
Use Cases & Benefits
- Implements a lightweight, high-performance inference framework for serving large language models with advanced optimizations in Python.
- Offers a compact, modular, and fully type-annotated codebase that balances readability with state-of-the-art throughput and latency.
- Use for deploying OpenAI-compatible API servers to serve large language models efficiently on single or multiple GPUs.
- Use for researchers needing a transparent reference implementation to study and modify modern LLM serving system internals.
- Use for interactive terminal-based chat sessions with large language models using a simple shell interface.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
MIT
Permissive: commercial use, modification and redistribution are allowed with attribution.
Community files
- README: present
Watch-outs
- No GitHub releases; pin a commit or tag instead of a release.
General guidance from repository metadata, not legal advice. How we score
From the README
A lightweight yet high-performance inference framework for Large Language Models.
Mini-SGLang is a compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems. With a compact codebase of ~5,000 lines of Python, it serves as both a capable inference engine and a transparent reference for researchers and developers.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
936+181
Open issues
72+24
Compared with peers in LLM
Fastest-growing repositories GStars tracks in this cohort for the week of Oct 18, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| DietrichGebert/ponytail | 174.8K | +9.9K | 75 | 7 days ago |
| xerj-org/xerj | 14.2K | +7.8K | 75 | today |
| affaan-m/ECC | 287.3K | +6.4K | 64 | 22 days ago |
| tashfeenahmed/freellmapi | 40.3K | +4.1K | 75 | today |
| JuliusBrussee/caveman | 114.4K | +2.2K | 75 | 9 days ago |
| sgl-project/mini-sglang | 5.4K | +0 | 75 | — |
| Category median | 114.4K | +6.4K | 75 | — |
Also by sgl-project
Other repositories from this maintainer that GStars tracks
Discover Repositories
Search across tracked repositories by name or description