NVIDIA-NeMo

    NVIDIA-NeMo/Automodel

    #577 this week

    🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

    nlp
    llm
    ai
    machine-learning
    agent
    deepseek-v4
    deepseek-v4-flash
    finetuning
    gemma3
    Python
    Apache-2.0
    1.0K stars
    341 forks
    1.0K GitHub watchers
    Updated Oct 17, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #577 of 3,103 repositories GStars tracks this week (top 19%).

    1 release in the last 90 days, the latest 52 days ago, with 142 contributors on GitHub.

    Use Cases & Benefits

    • Provides a PyTorch-native distributed training library for large language and vision-language models with out-of-the-box Hugging Face integration.
    • Enables scalable, flexible multi-GPU and multi-node training with minimal code changes using advanced parallelism and optimized custom kernels.
    • Use for fine-tuning large language models like LLaMA or Qwen on single or multi-node GPU clusters with minimal setup.
    • Use for efficient supervised and parameter-efficient fine-tuning of vision-language models such as Gemma3 or Qwen2.5-VL on image-text datasets.
    • Use for research and production workflows requiring seamless scaling from small experiments to massive distributed training with PyTorch DTensor and SPMD parallelism.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Nemo AutoModel is a Pytorch DTensor‑native SPMD open-source training library under NVIDIA NeMo Framework, designed to streamline and scale training and finetuning for LLMs and VLMs. Designed for flexibility, reproducibility, and scale, NeMo AutoModel enables both small-scale experiments and massive multi-GPU, multi-node deployments for fast experimentation in research and production environments.

    ⚠️ Note: NeMo AutoModel is under active development. New features, improvements, and documentation updates are released regularly. We are working toward a stable release, so expect the interface to solidify over time. Your feedback and contributions are welcome, and we encourage you to follow along as new updates roll out.

    TL;DR: SPMD turns “how to parallelize” into a runtime layout choice, not a code fork.

    Excerpt from the NVIDIA-NeMo/Automodel README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 14: +12Aug 15: +4

    +256 stars over 82 days across 9 snapshot days; best day +12 on Aug 14.

    Forks

    341+108

    Open issues

    488+140

    Compared with peers in NLP

    Fastest-growing repositories GStars tracks in this cohort for the week of Oct 18, by 7-day star growth

    NVIDIA-NeMo/Automodel compared with NLP repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    ruvnet/ruflo79.1K+3.3K75today
    mudler/LocalAI49.9K+345751 day ago
    camel-ai/camel18.0K+07549 days ago
    kyegomez/swarms7.3K+045662 days ago
    aurelio-labs/semantic-router4.0K+075today
    NVIDIA-NeMo/Automodel1.0K+05752 days ago
    Category median18.0K+075—

    Also by NVIDIA-NeMo

    Other repositories from this maintainer that GStars tracks

    Discover Repositories

    Search across tracked repositories by name or description