Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
5 releases in the last 90 days, the latest 3 days ago, with 24 contributors on GitHub.
Peaked at #9 in the weekly ranking the week of Dec 21, its best in the past year.
Use Cases & Benefits
- Runs frontier large language and vision-language models locally on Qualcomm devices using CPU, GPU, and NPU with minimal code.
- Enables efficient on-device multimodal AI inference with broad hardware backend support including Qualcomm NPU and multiple model formats.
- Use for deploying and running quantized LLMs and VLMs on Snapdragon-powered laptops or embedded devices for offline AI applications.
- Use for building multimodal AI agents that process text, images, and audio inputs locally without cloud dependency.
- Use for integrating an OpenAI-compatible API server to enable local AI model serving with function calling and streaming support.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
BSD 3-Clause
Permissive: commercial use, modification and redistribution are allowed with attribution.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Nexa SDK is an on-device inference framework that runs any model on any device, across any backend. It runs on CPUs, GPUs, NPUs with backend support for CUDA, Metal, Vulkan, and Qualcomm NPU. It handles multiple input modalities including text 📝, image 🖼️, and audio 🎧. The SDK includes an OpenAI-compatible API server with support for JSON schema-based function calling and streaming. It supports model formats such as GGUF, MLX, Nexa AI's own
.nexaformat, enabling efficient quantized inference across diverse platforms.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
1.1K+35
Open issues
88+51
Compared with peers in LLM
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| NVIDIA/auto-ontology | 11.4K | +8.5K | 75 | — |
| thedotmack/claude-mem | 115.8K | +4.7K | 75 | today |
| DietrichGebert/ponytail | 188.4K | +4.4K | 75 | 12 days ago |
| affaan-m/ECC | 300.8K | +4.3K | 75 | 40 days ago |
| Graphify-Labs/graphify | 145.7K | +3.8K | 75 | today |
| qualcomm/GenieX | 8.5K | — | 65 | 3 days ago |
| Category median | 145.7K | +4.4K | 75 | — |
Discover Repositories
Search across tracked repositories by name or description