mlc-ai/web-llm
High-performance In-browser LLM Inference Engine
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
2 releases in the last 90 days, the latest 16 days ago, with 55 contributors on GitHub.
Gained 34% more stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides a high-performance in-browser large language model inference engine accelerated by WebGPU without server dependency.
- Enables full OpenAI API compatibility for local, privacy-preserving LLM usage with streaming, JSON-mode, and function-calling support.
- Use for building privacy-focused AI chatbots that run entirely in the browser with GPU acceleration and no backend.
- Use for integrating custom or open-source LLMs into web applications with modular, plug-and-play TypeScript interfaces.
- Use for developing browser extensions or offline-capable web apps leveraging service workers for persistent LLM inference.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
High-Performance In-Browser LLM Inference Engine.
WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU.
WebLLM is fully compatible with OpenAI API. That is, you can use the same OpenAI API on any open source models locally, with functionalities including streaming, JSON-mode, function-calling (WIP), etc.
We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.
You can use WebLLM as a base npm package and build your own web application on top of it by following the examples below. This project is a companion project of MLC LLM, which enables universal deployment of LLM across hardware environments.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+799 stars over 81 days across 17 snapshot days; best day +173 on Sep 3.
Forks
1.4K+60
Open issues
153+1
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| thedotmack/claude-mem | 113.6K | +8.8K | 35 | today |
| D4Vinci/Scrapling | 98.1K | +6.9K | 65 | 1 day ago |
| Leonxlnx/taste-skill | 110.7K | +5.2K | 55 | 1 day ago |
| calesthio/OpenMontage | 77.2K | +4.2K | 40 | — |
| heygen-com/hyperframes | 79.6K | +4.1K | 45 | today |
| mlc-ai/web-llm | 19.3K | — | 59 | 16 days ago |
| Category median | 98.1K | +5.2K | 45 | — |
Discover Repositories
Search across tracked repositories by name or description