labmlai

    labmlai/annotated_deep_learning_paper_implementations

    #235 this week

    ๐Ÿง‘โ€๐Ÿซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐Ÿ“; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ŸŽฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐Ÿง 

    deep-learning
    machine-learning
    attention
    deep-learning-tutorial
    gan
    literate-programming
    lora
    Python
    MIT
    67.5K stars
    6.8K forks
    67.5K GitHub watchers
    Updated Oct 7, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #235 of 2,841 repositories GStars tracks this week (top 8%).

    The project lists 39 contributors on GitHub.

    Use Cases & Benefits

    • Provides over 60 PyTorch implementations of deep learning papers with side-by-side explanatory notes for better understanding.
    • Combines code and detailed documentation to facilitate learning and experimentation with state-of-the-art neural network architectures and algorithms.
    • Use for studying and reproducing transformer models including GPT, Vision Transformer, and Switch Transformer with clear tutorials.
    • Use for exploring generative models like GANs, diffusion models, and reinforcement learning algorithms with practical implementations.
    • Use for experimenting with advanced optimizers, normalization techniques, and adaptive computation methods in deep learning research.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    MIT

    Permissive: commercial use, modification and redistribution are allowed with attribution.

    Community files

    • README: present

    Watch-outs

    • No commits in the last six months (last push Jan 2026).
    • No GitHub releases; pin a commit or tag instead of a release.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations,

    The website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better.

    We are actively maintaining this repo and adding new implementations almost weekly. for updates.

    Excerpt from the labmlai/annotated_deep_learning_paper_implementations README on GitHub (MIT license). ยฉ its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Forks

    6.8K+18

    Open issues

    44+11

    Compared with peers in Deep Learning

    Fastest-growing repositories GStars tracks in this cohort for the week of Oct 4, by 7-day star growth

    labmlai/annotated_deep_learning_paper_implementations compared with Deep Learning repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    rohitg00/ai-engineering-from-scratch68.7K+3.5K753 days ago
    p-e-w/heretic35.1K+1.5K41121 days ago
    pytorch/pytorch104.9K+4227513 days ago
    labmlai/annotated_deep_learning_paper_implementations67.5K+075โ€”
    roboflow/supervision51.2K+0751 day ago
    pyg-team/pytorch_geometric24.1K+040today
    Category median51.2K+42275โ€”

    Discover Repositories

    Search across tracked repositories by name or description