intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
No releases in the last 90 days; the most recent was 101 days ago, with 12 contributors on GitHub.
Gained 63% fewer stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides an open-source platform for load balancing and serving large language and vision models on self-hosted infrastructure.
- Simplifies deployment with fewer components and integrates tightly with the ggml ecosystem for efficient CPU and GPU inference.
- Use for building scalable, private LLM inference services within organizations requiring full control over their AI models.
- Use for DevOps teams needing dynamic autoscaling and request buffering to optimize resource usage in multi-agent LLM clusters.
- Use for organizations in regulated industries to maintain compliance and predictable costs by self-hosting sensitive AI workloads.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Digital products and their users need privacy, reliability, cost control and an option to be independent from third party vendors.
Paddler is an open-source LLMOps platform for organizations that host and scale open-source models in their own infrastructure.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
97+5
Open issues
30+3
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| thedotmack/claude-mem | 113.6K | +8.8K | 35 | today |
| D4Vinci/Scrapling | 98.1K | +6.9K | 65 | 1 day ago |
| Leonxlnx/taste-skill | 110.7K | +5.2K | 55 | 1 day ago |
| calesthio/OpenMontage | 77.2K | +4.2K | 40 | — |
| heygen-com/hyperframes | 79.6K | +4.1K | 45 | today |
| intentee/paddler | 1.7K | — | 33 | 101 days ago |
| Category median | 98.1K | +5.2K | 45 | — |
Discover Repositories
Search across tracked repositories by name or description