# LLM Serving repositories

Source: https://www.gstars.dev/c/llm-serving
Tracked repositories: 6
Ranking: Total stars

1. [vllm-project/vllm](https://www.gstars.dev/repo/vllm-project/vllm) — 96626 stars
2. [NVIDIA/TensorRT-LLM](https://www.gstars.dev/repo/NVIDIA/TensorRT-LLM) — 15031 stars
3. [skypilot-org/skypilot](https://www.gstars.dev/repo/skypilot-org/skypilot) — 10809 stars
4. [gpustack/gpustack](https://www.gstars.dev/repo/gpustack/gpustack) — 5984 stars
5. [vllm-project/vllm-ascend](https://www.gstars.dev/repo/vllm-project/vllm-ascend) — 3039 stars
6. [SemiAnalysisAI/InferenceX](https://www.gstars.dev/repo/SemiAnalysisAI/InferenceX) — 1985 stars

Category/topic matches include curated categories and collected GitHub topics. Coverage is limited to tracked active, non-archived, non-fork repositories. See https://www.gstars.dev/methodology for measurement limits.