Mesh-LLM/mesh-llm
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #14 among AI repositories ranked this week; #119 of 182 repositories with measured growth this week (top 65%).
5 releases in the last 90 days, the latest 7 days ago, with 42 contributors on GitHub.
Use Cases & Benefits
- Enables distributed serving of large AI language models by pooling GPU resources across multiple machines with an OpenAI-compatible API.
- Automatically balances model workloads across nodes using pipeline and expert parallelism to run models larger than a single machine's capacity.
- Use for creating a private or public mesh to share GPU compute for hosting large language models collaboratively.
- Use for providing local OpenAI-compatible endpoints to AI agents and tools without manual integration of each model or service.
- Use for running multi-model inference setups where different nodes serve different models simultaneously with automatic request routing.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Mesh LLM lets you pool spare GPU capacity across machines and expose the result as one OpenAI-compatible API.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+744 stars over 86 days across 15 snapshot days; best day +49 on Nov 2.
Forks
498+114
Open issues
156+91
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| thedotmack/claude-mem | 113.6K | +8.8K | 35 | today |
| D4Vinci/Scrapling | 98.1K | +6.9K | 65 | 1 day ago |
| Leonxlnx/taste-skill | 110.7K | +5.2K | 55 | 1 day ago |
| calesthio/OpenMontage | 77.2K | +4.2K | 40 | — |
| heygen-com/hyperframes | 79.6K | +4.1K | 45 | today |
| Mesh-LLM/mesh-llm | 4.0K | +309 | 60 | 7 days ago |
| Category median | 98.1K | +5.2K | 45 | — |
Discover Repositories
Search across tracked repositories by name or description