Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

OfinTech Desk
OfinTech Desk
Busbar
Busbar
It's a plan
It's a plan
Bifrost
Bifrost
Omnigraph
Omnigraph

skyzh/tiny-llm

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

#Learning resources
Visit GitHub
Python
5.8k
553
26 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Momentum

How fast skyzh/tiny-llm is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 20 – Nov 19, 2026

Stars +1,209 in 61 days

0200400600
473

Forks +166 in 61 days

050100
66

Merged PRs 34 in 61 days

051015
13

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 in Python

5
Sep 20Sep 28Oct 6Oct 14Oct 22Oct 30Nov 7Nov 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsPython
Sun, Sep 20, 2026+1+00Not trending
Mon, Sep 21, 2026+34+60Not trending
Tue, Sep 22, 2026+65+70Not trending
Wed, Sep 23, 2026+27+20Not trending
Thu, Sep 24, 2026+16+05Not trending
Fri, Sep 25, 2026+3+11Not trending
Sat, Sep 26, 2026+3+00Not trending
Sun, Sep 27, 2026+3+01Not trending
Mon, Sep 28, 2026+0+00Not trending
Tue, Sep 29, 2026+3+20Not trending
Wed, Sep 30, 2026+6+10Not trending
Thu, Oct 1, 2026+4+00Not trending
Fri, Oct 2, 2026+1+00Not trending
Sat, Oct 3, 2026+4+00Not trending
Sun, Oct 4, 2026+1+10Not trending
Mon, Oct 5, 2026+1+00Not trending
Tue, Oct 6, 2026+4+00Not trending
Wed, Oct 7, 2026+2+00Not trending
Thu, Oct 8, 2026+5+10Not trending
Fri, Oct 9, 2026+2+10Not trending
Sat, Oct 10, 2026+2+10Not trending
Sun, Oct 11, 2026+1+00Not trending
Mon, Oct 12, 2026+3+00Not trending
Tue, Oct 13, 2026+0+00Not trending
Wed, Oct 14, 2026+2+20Not trending
Thu, Oct 15, 2026+0+10Not trending
Fri, Oct 16, 2026+2+10Not trending
Sat, Oct 17, 2026+1+40Not trending
Sun, Oct 18, 2026+1+60Not trending
Mon, Oct 19, 2026+2+30Not trending
Tue, Oct 20, 2026+4+00Not trending
Wed, Oct 21, 2026+3+00Not trending
Thu, Oct 22, 2026+2+10Not trending
Fri, Oct 23, 2026+1+00Not trending
Sat, Oct 24, 2026+1+00Not trending
Sun, Oct 25, 2026+0+00Not trending
Mon, Oct 26, 2026+1+00Not trending
Tue, Oct 27, 2026+1+00Not trending
Wed, Oct 28, 2026+0+00Not trending
Thu, Oct 29, 2026+68+60Not trending
Fri, Oct 30, 2026+473+660#5
Sat, Oct 31, 2026+160+151Not trending
Sun, Nov 1, 2026+16+00Not trending
Mon, Nov 2, 2026+17+60Not trending
Tue, Nov 3, 2026+10+20Not trending
Wed, Nov 4, 2026+20+10Not trending
Thu, Nov 5, 2026+77+110Not trending
Fri, Nov 6, 2026+47+44Not trending
Sat, Nov 7, 2026+11+213Not trending
Sun, Nov 8, 2026+3+20Not trending
Mon, Nov 9, 2026+7+00Not trending
Tue, Nov 10, 2026+12+10Not trending
Wed, Nov 11, 2026+8+21Not trending
Thu, Nov 12, 2026+9+20Not trending
Fri, Nov 13, 2026+6+10Not trending
Sat, Nov 14, 2026+5+00Not trending
Sun, Nov 15, 2026+4+00Not trending
Mon, Nov 16, 2026+4+08Not trending
Tue, Nov 17, 2026+5+00Not trending
Wed, Nov 18, 2026+13+30Not trending
Thu, Nov 19, 2026+22+10Not trending
Total+1,209+16634
  • 1#1 on the list
  • 7Rank that day
  • Not trending
17
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Python

    Sep 13, 2025Best #17

    #1#5#10#15#20#25
    Top 10
    Sep 13, 2025
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about skyzh/tiny-llm, and every badge it has earned
    1. Nov 71 post
      • 有人把 vLLM 的核心技术,做成了一门免费的实战课。 KV Cache、4-bit 量化、Metal 算子、Batching…… 不需要 NVIDIA GPU。 一台 8GB Mac,就能开始手搓大模型推理引擎。 GitHub:

        Read full on X, posted by @heydengai

        @heydengai · x.com

    2. Nov 41 post
      • Someone turned the hardest parts of LLM inference engineering into a course where you have to fix the performance problems yourself. it’s called tiny-llm, an open-source course for building a small…

        Read full on X, posted by @oliviscusAI

        @oliviscusAI · x.com

    3. Oct 302 posts
      • Learn LLM inference system on Apple Silicon

        Read full on Hacker News

        Hacker News

      • Found a great resource for anyone who wants to understand LLM inference beyond just using APIs. Tiny-LLM is a hands-on course that teaches you how to build an LLM serving system from scratch using…

        Read full on X, posted by @shubh6200

        @shubh6200 · x.com

    4. 5 months earlier
    5. Jun 101 post
      • Day 13/150 Trying to practice TileLang irl. For the next week I plan to implement Qwen3 entirely with TileLang as backend and run some experiments. Found this great resource by @iskyzh and…

        Read full on X, posted by @Retep8080

        @Retep8080 · x.com

    You might also like

    Repositories close to skyzh/tiny-llm
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    Busbar

    Control what AI can do before it acts

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    videlalvaro/inference-school

    Swift

    A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.

    19416

    basecompute/baseRT

    Rust

    Fastest LLM inference runtime for Apple Silicon

    25021

    SharpAI/SwiftLM

    Swift

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    80263

    Goekdeniz-Guelmez/mlx-lm-lora

    Python

    Train Large Language Models on MLX.

    47266

    perplexityai/pplx-garden

    Rust

    Perplexity open source garden for inference technology

    958123

    quantumnic/ssd-llm

    Rust

    Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac

    666

    Prasannajaga/inference-book

    Jupyter Notebook

    everything you need to know about inference engineering

    453

    waybarrios/vllm-mlx

    Python

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    1.7k266

    ddttom/mlx-llm-tutorial

    Python

    A tutorial on Apple MLX and LLM

    635