vllm-project/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #386 of 2,845 repositories GStars tracks this week (top 14%).
1 release in the last 90 days, the latest 3 days ago, with 213 contributors on GitHub.
Peaked at #50 in the weekly ranking the week of Jan 25, its best in the past year.
Use Cases & Benefits
- Provides cloud-native infrastructure components to deploy, manage, and scale large language model inference efficiently.
- Optimizes GenAI inference with cost-efficient, scalable, and pluggable Kubernetes-based solutions tailored for enterprise workloads.
- Use for building scalable LLM inference platforms that dynamically autoscale based on real-time demand.
- Use for integrating heterogeneous GPU resources to reduce inference costs while maintaining service level objectives.
- Use for implementing distributed key-value caching and load balancing to improve throughput and reliability of GenAI services.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Welcome to AIBrix, an open-source initiative designed to provide essential building blocks to construct scalable GenAI inference infrastructure. AIBrix delivers a cloud-native solution optimized for deploying, managing, and scaling large language model (LLM) inference, tailored specifically to enterprise needs.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
739+116
Open issues
414+71
Compared with peers in Backend
Fastest-growing repositories GStars tracks in this cohort for the week of Oct 11, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| NationalSecurityAgency/ghidra | 93.7K | +7.5K | 75 | 1 day ago |
| DuarteSantos8/openGym | 15.2K | +4.4K | 40 | today |
| K-Dense-AI/scientific-agent-skills | 54.2K | +3.2K | 75 | 22 days ago |
| 666ghj/MiroFish | 80.7K | +2.4K | 23 | 226 days ago |
| anthropics/claude-plugins-official | 44.1K | +2.3K | 35 | — |
| vllm-project/aibrix | 5.1K | +0 | 75 | 3 days ago |
| Category median | 54.2K | +3.2K | 40 | — |
Also by vllm-project
Other repositories from this maintainer that GStars tracks
- Python95.3K stars
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- Python7.2K stars
vllm-omni
A framework for efficient model inference with omni-modality models
- Go6.2K stars
semantic-router
An open, programmable decision layer for models and compute.
- Python3.0K stars
vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
- JavaScript1.1K stars
recipes
Common recipes to run vLLM
Discover Repositories
Search across tracked repositories by name or description