GStars
    google-ai-edge

    google-ai-edge/LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    developer-tools
    edge-ai
    on-device-ai
    on-device-llm
    C++
    Apache-2.0
    6.8K stars
    781 forks
    6.8K GitHub watchers
    Updated Nov 4, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    5 releases in the last 90 days, the latest 1 day ago, with 49 contributors on GitHub.

    Peaked at #9 in the weekly ranking the week of Apr 5, its best in the past year.

    Use Cases & Benefits

    • Provides a high-performance, open-source inference framework for deploying Large Language Models on edge devices.
    • Enables efficient on-device AI with hardware acceleration across diverse platforms including mobile, desktop, and IoT devices.
    • Use for integrating state-of-the-art language models into Android apps with Kotlin for native performance.
    • Use for prototyping and scripting AI workflows in Python with stable API support.
    • Use for deploying multi-modal AI applications on resource-constrained devices like Raspberry Pi using C++.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    Deploy Gemma 4 across a broad range of hardware with stellar performance (blog).

    Excerpt from the google-ai-edge/LiteRT-LM README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Forks

    781+113

    Open issues

    758+216

    Compared with peers in Developer Tools

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth

    View category →
    google-ai-edge/LiteRT-LM compared with Developer Tools repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    stablyai/orca116.8K+6.6K40today
    affaan-m/ECC297.9K+5.2K6335 days ago
    DietrichGebert/ponytail185.3K+5.1K607 days ago
    herdrdev/herdr48.3K+1.7K5922 days ago
    The-PR-Agent/pr-agent15.1K+1.5K6411 days ago
    google-ai-edge/LiteRT-LM6.8K—651 day ago
    Category median116.8K+5.1K60—
    Compare LiteRT-LM with orca, ECC, ponytail →

    Also by google-ai-edge

    Other repositories from this maintainer that GStars tracks

    Discover Repositories

    Search across tracked repositories by name or description