google-ai-edge/LiteRT
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
2 releases in the last 90 days, the latest 18 days ago, with 233 contributors on GitHub.
Gained 66% fewer stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides a high-performance on-device machine learning and generative AI runtime framework optimized for edge platforms.
- Delivers advanced GPU and NPU acceleration with automated hardware selection and asynchronous execution for superior inference speed and efficiency.
- Use for deploying optimized ML models on mobile devices with CPU, GPU, and NPU support across Android, iOS, and other platforms.
- Use for integrating and accelerating generative AI models like large language models and diffusion models on edge devices.
- Use for converting and running PyTorch models efficiently on-device using LiteRT's conversion tools and runtime APIs.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Google's on-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
LiteRT continues the legacy of TensorFlow Lite as the trusted, high-performance runtime for on-device AI.
LiteRT features advanced GPU/NPU acceleration, delivers superior ML & GenAI performance, making on-device ML inference easier than ever.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
479+66
Open issues
3.2K+892
Compared with peers in Developer Tools
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| stablyai/orca | 116.8K | +6.6K | 40 | today |
| affaan-m/ECC | 297.9K | +5.2K | 63 | 35 days ago |
| DietrichGebert/ponytail | 185.3K | +5.1K | 60 | 7 days ago |
| herdrdev/herdr | 48.3K | +1.7K | 59 | 22 days ago |
| The-PR-Agent/pr-agent | 15.1K | +1.5K | 64 | 11 days ago |
| google-ai-edge/LiteRT | 3.5K | — | 64 | 18 days ago |
| Category median | 116.8K | +5.1K | 60 | — |
Also by google-ai-edge
Other repositories from this maintainer that GStars tracks
- C++37.6K stars
mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
- Kotlin25.2K stars
gallery
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
- C++6.8K stars
LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Discover Repositories
Search across tracked repositories by name or description