Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

It's a plan
It's a plan
Omnigraph
Omnigraph
Bifrost
Bifrost
Busbar
Busbar
OfinTech Desk
OfinTech Desk

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

#Learning resources#LLM training
Visit GitHub
Jupyter Notebook
108.6k
17.2k
64 contributors
Custom license
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Momentum

How fast rasbt/LLMs-from-scratch is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 19 – Nov 18, 2026

Stars +3,420 in 61 days

050100
89

Forks +812 in 61 days

02040
33

Merged PRs 21 in 61 days

0246
5

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 in Jupyter Notebook

8761138648615751021326141071066529472364771281713131114179108737652668711
Sep 19Sep 27Oct 5Oct 13Oct 21Oct 29Nov 6Nov 14
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsJupyter Notebook
Sat, Sep 19, 2026+39+120#8
Sun, Sep 20, 2026+59+150#7
Mon, Sep 21, 2026+61+30#6
Tue, Sep 22, 2026+42+171#11
Wed, Sep 23, 2026+68+160#3
Thu, Sep 24, 2026+42+90#8
Fri, Sep 25, 2026+61+60#6
Sat, Sep 26, 2026+47+140#4
Sun, Sep 27, 2026+46+80#8
Mon, Sep 28, 2026+56+130#6
Tue, Sep 29, 2026+40+90#15
Wed, Sep 30, 2026+57+94#7
Thu, Oct 1, 2026+37+332#5
Fri, Oct 2, 2026+35+181#10
Sat, Oct 3, 2026+67+140#2
Sun, Oct 4, 2026+52+140#1
Mon, Oct 5, 2026+67+90#3
Tue, Oct 6, 2026+59+130#2
Wed, Oct 7, 2026+52+110#6
Thu, Oct 8, 2026+41+80#14
Fri, Oct 9, 2026+45+100#10
Sat, Oct 10, 2026+64+120#7
Sun, Oct 11, 2026+38+140#10
Mon, Oct 12, 2026+61+130#6
Tue, Oct 13, 2026+52+70#6
Wed, Oct 14, 2026+50+130#5
Thu, Oct 15, 2026+80+170#2
Fri, Oct 16, 2026+59+170#9
Sat, Oct 17, 2026+68+120#4
Sun, Oct 18, 2026+54+140#7
Mon, Oct 19, 2026+88+160#2
Tue, Oct 20, 2026+82+190#3
Wed, Oct 21, 2026+71+150#6
Thu, Oct 22, 2026+69+110#4
Fri, Oct 23, 2026+55+150#7
Sat, Oct 24, 2026+57+170#7
Sun, Oct 25, 2026+58+130#12
Mon, Oct 26, 2026+80+190#8
Tue, Oct 27, 2026+48+190#17
Wed, Oct 28, 2026+48+140#13
Thu, Oct 29, 2026+57+160#13
Fri, Oct 30, 2026+56+155#11
Sat, Oct 31, 2026+41+160#14
Sun, Nov 1, 2026+40+140#17
Mon, Nov 2, 2026+59+160#9
Tue, Nov 3, 2026+60+180#10
Wed, Nov 4, 2026+54+100#8
Thu, Nov 5, 2026+52+93#7
Fri, Nov 6, 2026+53+74#3
Sat, Nov 7, 2026+48+110#7
Sun, Nov 8, 2026+54+200#6
Mon, Nov 9, 2026+78+151#5
Tue, Nov 10, 2026+89+190#2
Wed, Nov 11, 2026+53+100#6
Thu, Nov 12, 2026+63+220#6
Fri, Nov 13, 2026+49+140#8
Sat, Nov 14, 2026+52+110#7
Sun, Nov 15, 2026+49+100#11
Mon, Nov 16, 2026+56+130Not trending
Tue, Nov 17, 2026+46+80Not trending
Wed, Nov 18, 2026+56+00Not trending
Total+3,420+81221
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    All languages

    Jan 28, 2024 – May 13, 2026#1 on 2 days

    #1#5#10#15#20#25
    Top 10
    Feb 2024AugFebAugFeb
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about rasbt/LLMs-from-scratch, and every badge it has earned
    1. Nov 132 posts
      • 整理了一条从地基到 Agent,再到 RL 和论文的学习路线。前面是课和书,中间是能自己跑的项目,最后是读论文、写论文的方法。 1. 先把地基打好 Karpathy 的 Neural Networks: Zero to Hero,适合从零把神经网络,以及 GPT 的最小实现走通 他现在把从零训练这条线放在了 nanochat,nanoGPT 已经停更 斯坦福 CS336 Language…

        Read full on X, posted by @Zwx050616

        @Zwx050616 · x.com

      • 整理了一条从地基到 Agent,再到 RL 和论文的学习路线。前面是课和书,中间是能自己跑的项目,最后是读论文、写论文的方法。 1. 先把地基打好 Karpathy 的 Neural Networks: Zero to Hero,适合从零把神经网络,以及 GPT 的最小实现走通 他现在把从零训练这条线放在了 nanochat,nanoGPT 已经停更 斯坦福 CS336 Language…

        Read full on X, posted by @Zwx050616

        @Zwx050616 · x.com

    2. Nov 121 post
      • 想学 AI 的朋友,这 7 个 GitHub 项目建议收藏!🤖 从零开始学 AI、开发自己的智能体,甚至亲手构建 GPT 模型,都能找到对应的免费学习资源。 ① 微软 AI Agents for Beginners 18 节课程,从基础到实战,学习工具调用、RAG、智能体记忆和多智能体协作。 ② Hugging Face Agents Course 通过实际项目学习 AI Agent,涉及…

        Read full on X, posted by @iMicodex

        @iMicodex · x.com

    3. 12 days earlier
    4. Oct 311 post
      • Want to get really good at generative AI? Save these 10 GitHub repos. 👇 The diagram is where they lead: AI agents with memory, tools, and a human still in control.

        Read full on X, posted by @danielishakutv

        @danielishakutv · x.com

    5. Oct 301 post
      • foundations 01 micrograd: the tiny engine behind neural nets 02 nn-zero-to-hero: karpathy's full course, zero to GPT 03 nanoGPT: train your own small GPT

        Read full on X, posted by @SanketShips

        @SanketShips · x.com

    6. 18 days earlier
    7. Oct 121 post
      • 用 Codex 整理了目前比较主流的 LLM 学习教程 偏动手写代码、理解模型原理和训练流程: 1. Zero to Hero|@Karpathy OpenAI 创始团队成员、前特斯拉 AI 负责人 从神经网络基础讲起带你手写语言模型、GPT 和分词器 2. LLMs from Scratch|@rasbt 前威斯康星大学麦迪逊分校教授、机器学习畅销书作者 用 PyTorch 从零实现…

        Read full on X, posted by @antiAIvo

        @antiAIvo · x.com

    8. Oct 61 post
      • 10.6 万星。这份教程从零用 PyTorch 搭出类 ChatGPT 模型:注意力、训练、微调、加载权重,代码能跑。 与其争论 AI 会取代谁,不如搞清它在算什么。

        Read full on X, posted by @laogeai

        @laogeai · x.com

    9. Oct 31 post
      • ❌️stop buying $50 technical books just to let them sit on your shelf. Most people read them wrong, here are 12 books that actually build production-grade AI & systems (with free links + GitHub…

        Read full on X, posted by @IamSandipNayak

        @IamSandipNayak · x.com

    10. 11 days earlier
    11. Sep 221 post
      • 2. ​GenAI for Beginners - 3. ​LangChain -

        Read full on X, posted by @theaifastlane

        @theaifastlane · x.com

    12. Sep 161 post
      • Build a Large Language Model from scratch! This repository contains the code examples for developing, pretraining, and finetuning a LLM from scratch. It is the official codebase for the book Build a…

        Read full on X, posted by @Sumanth_077

        @Sumanth_077 · x.com

    You might also like

    Repositories close to rasbt/LLMs-from-scratch
    FeaturedAdvertise to 180K+ monthly visitors
    Busbar

    Control what AI can do before it acts

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    fangpin/llm-from-scratch

    Python

    Build LLM from scratch

    13615

    analyticalrohit/llms-from-scratch

    Jupyter Notebook

    Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.

    38892

    raiyanyahya/how-to-train-your-gpt

    Jupyter Notebook

    Build a modern LLM from scratch. Every line commented. Explained like we are five.

    4.2k545

    vivekkalyanarangan30/llm_from_scratch

    Python
    1.1k305

    mikexcohen/LLM_course

    Jupyter Notebook

    Code files for course "A deep understanding of AI large language model mechanisms"

    365225

    YeonwooSung/llm-architecture-from-scratch

    Python

    Implementing LLM architectures from scratch in PyTorch

    8566

    jingedawang/TutorialLLM

    Jupyter Notebook

    LLM Tutorial for Everyone.

    9018

    mechramc/Under-the-hood

    Python

    Under the Hood - Build Every Layer of a Large Language Model from Scratch. A 36-project, build-it/break-it/measure-it manual by Ramchand Kumaresan.

    10633

    nerdai/llms-from-scratch-rs

    Rust

    A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.

    34443