Michael-A-Kuykendall/shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
5 releases in the last 90 days, the latest 13 days ago, with 1 contributor on GitHub.
Gained 71% fewer stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides a pure Rust, single-binary OpenAI-compatible inference engine for local GGUF models running on any GPU without Python dependencies.
- Delivers ultra-lightweight, zero-configuration local AI inference with automatic GPU backend detection and advanced CPU/GPU hybrid processing for large models.
- Use for running private, local LLM inference servers compatible with existing OpenAI SDKs and tools without code changes.
- Use for deploying large 70B+ parameter models efficiently on consumer hardware with intelligent CPU offloading and hybrid acceleration.
- Use for integrating local AI inference into developer workflows like VSCode Copilot, Cursor IDE, and Continue.dev with minimal setup.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
- Owned by an individual account with a single contributor on GitHub; plan for bus-factor risk.
General guidance from repository metadata, not legal advice. How we score
From the README
Shimmy will be free forever. No asterisks. No "free for now." No pivot to paid.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
586+36
Open issues
9-1
Compared with peers in Developer Tools
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| stablyai/orca | 116.8K | +6.6K | 40 | today |
| affaan-m/ECC | 297.9K | +5.2K | 63 | 35 days ago |
| DietrichGebert/ponytail | 185.3K | +5.1K | 60 | 7 days ago |
| herdrdev/herdr | 48.3K | +1.7K | 59 | 22 days ago |
| The-PR-Agent/pr-agent | 15.1K | +1.5K | 64 | 11 days ago |
| Michael-A-Kuykendall/shimmy | 6.0K | — | 37 | 13 days ago |
| Category median | 116.8K | +5.1K | 60 | — |
Discover Repositories
Search across tracked repositories by name or description