Layr-Labs/d-inference
Private Inference Network on Idle Macs
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
5 releases in the last 90 days, the latest today, with 26 contributors on GitHub.
Use Cases & Benefits
- Turns idle Apple Silicon Macs into a decentralized, private inference cloud compatible with OpenAI and Anthropic APIs.
- Ensures strong privacy by running inference in a hardened process with end-to-end encryption and hardware attestation preventing providers from accessing plaintext data.
- Use for deploying private AI inference workloads on personal or enterprise Apple Silicon Macs without exposing sensitive prompts or responses.
- Use for building cost-effective, privacy-preserving AI services leveraging underutilized Mac hardware with zero platform fees during public alpha.
- Use for developers needing an OpenAI-compatible API that supports streaming, multimodal inputs, and continuous batching with verifiable provider trust levels.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Other
GitHub could not identify this license; read the LICENSE file before depending on it.
Community files
- README: present
- Contributing guide: present
Watch-outs
- License not identified by GitHub; read the LICENSE file before depending on it.
General guidance from repository metadata, not legal advice. How we score
From the README
Public Alpha — Darkbloom is a decentralized private-inference network for Apple Silicon. Expect rough edges, breaking changes, and downtime. During the alpha, providers keep 100% of revenue (0% platform fee).
Darkbloom turns idle Macs into a private, OpenAI-compatible inference cloud.
Today, AI compute reaches you through a stack of markups — chipmaker to hyperscaler to API vendor. Meanwhile, over 100 million Apple Silicon Macs sit mostly idle, each with up to 512 GB of unified memory and up to 819 GB/s of bandwidth — enough to run frontier-scale models at interactive speeds. Darkbloom connects that idle capacity directly to demand, and pays the people who own the machines.
The hard part is privacy. The person running a provider node has root and physical custody of the machine doing your inference — yet they must not be able to read your prompts or the model's responses. Darkbloom closes every software path to that plaintext:
What remains is the same residual threat model Apple accepts for Private Cloud Compute: physically de-soldering and probing memory chips. Everything short of that is engineered out.
The API is OpenAI- and Anthropic-compatible, so most clients work by changing one base URL.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+339 stars over 89 days across 14 snapshot days; best day +12 on Aug 27.
Forks
128+82
Open issues
197+7
Compared with peers in Backend
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| anthropics/skills | 187.8K | +2.9K | 15 | — |
| DuarteSantos8/openGym | 19.7K | +2.4K | 60 | 2 days ago |
| shiyu-coder/Kronos | 47.0K | +2.3K | 16 | — |
| NationalSecurityAgency/ghidra | 98.2K | +2.3K | 64 | 14 days ago |
| microsoft/VibeVoice | 56.0K | +1.1K | 29 | — |
| Layr-Labs/d-inference | 571 | — | 40 | today |
| Category median | 56.0K | +2.3K | 29 | — |
Discover Repositories
Search across tracked repositories by name or description