mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
5 releases in the last 90 days, the latest 12 days ago, with 274 contributors on GitHub.
Peaked at #3 in the weekly ranking the week of Nov 2, its best in the past year.
Use Cases & Benefits
- Provides an open-source AI engine to run large language models, vision, voice, image, and video models locally on any hardware without requiring a GPU.
- Enables local AI inferencing with a drop-in OpenAI-compatible REST API, supporting multiple model families and automatic backend detection for diverse hardware.
- Use for deploying AI models on consumer-grade hardware in environments with limited or no GPU availability to maintain privacy and reduce cloud dependency.
- Use for integrating multimodal AI capabilities like text generation, image creation, audio transcription, and object detection into on-premises applications.
- Use for building decentralized or distributed AI systems leveraging P2P inferencing and federated modes for collaborative AI workloads across multiple devices.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
MIT
Permissive: commercial use, modification and redistribution are allowed with attribution.
Community files
- README: present
- Contributing guide: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
:bulb: Get help - ❓FAQ 💭Discussions :speech_balloon: Discord :book: Documentation website
💻 Quickstart 🖼️ Models 🚀 Roadmap 🥽 Demo 🌍 Explorer 🛫 Examples Try on
LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by Ettore Di Giacinto.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+1,896 stars over 90 days across 33 snapshot days; best day +45 on Oct 22.
Forks
4.6K+228
Open issues
171+24
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| D4Vinci/Scrapling | 101.1K | +6.3K | 75 | 6 days ago |
| thedotmack/claude-mem | 115.8K | +4.7K | 75 | today |
| heygen-com/hyperframes | 82.3K | +4.0K | 75 | today |
| harry0703/MoneyPrinterTurbo | 142.0K | +3.8K | 75 | 3 days ago |
| github/spec-kit | 149.2K | +2.6K | 75 | today |
| mudler/LocalAI | 50.2K | — | 59 | 12 days ago |
| Category median | 115.8K | +4.0K | 75 | — |
Also by mudler
Other repositories from this maintainer that GStars tracks
- Go2.1K stars
edgevpn
:sailboat: The immutable, decentralized, statically built p2p VPN without any central server and automatic discovery! Create decentralized introspectable tunnels over p2p with shared tokens
- Go2.0K stars
LocalAGI
LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for OpenAI's Responses APIs with advanced agentic capabilities. No clouds. Local AI that works on consumer-grade hardware (CPU and GPU).
Discover Repositories
Search across tracked repositories by name or description