kserve/kserve
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #312 of 2,794 repositories GStars tracks this week (top 11%).
5 releases in the last 90 days, the latest 25 days ago, with 377 contributors on GitHub.
Gained 26% more stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides a standardized distributed platform for scalable generative and predictive AI model inference on Kubernetes.
- Unifies multi-framework AI inference with advanced autoscaling, model caching, and seamless integration for both generative and predictive workloads.
- Use for deploying large language models with GPU acceleration and optimized memory management on Kubernetes clusters.
- Use for serving multi-framework predictive models like TensorFlow, PyTorch, and XGBoost with intelligent routing and canary rollouts.
- Use for implementing cost-efficient AI inference pipelines with scale-to-zero autoscaling and built-in model explainability features.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
KServe is a standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes.
KServe is being used by many organizations and is a Cloud Native Computing Foundation (CNCF) incubating project.
For more details, visit the KServe website.
Single platform that unifies Generative and Predictive AI inference on Kubernetes. Simple enough for quick deployments, yet powerful enough to handle enterprise-scale AI workloads with advanced features.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+410 stars over 87 days across 15 snapshot days; best day +21 on Sep 16.
Forks
1.7K+150
Open issues
211-75
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Oct 18, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| storytold/artcraft | 35.6K | +6.7K | 75 | 26 days ago |
| heygen-com/hyperframes | 70.0K | +5.7K | 45 | today |
| Comfy-Org/ComfyUI | 142.0K | +4.4K | 60 | 3 days ago |
| Leonxlnx/taste-skill | 101.1K | +4.0K | 75 | 2 days ago |
| ifixai-ai/iFixAi | 30.7K | +3.3K | 75 | 5 days ago |
| kserve/kserve | 6.1K | +0 | 75 | 25 days ago |
| Category median | 70.0K | +4.4K | 75 | — |
Discover Repositories
Search across tracked repositories by name or description