Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Bifrost
Bifrost
ClawBench
ClawBench

IaroslavElistratov/gpu-kernel-engineering

B200 Attention from Scratch: understand one of the hardest GPU kernels on the latest hardware

#Learning resources
Visit GitHub
Cuda
95
6
1 contributors
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

ClawBench

a benchmark for personal agents

Momentum

How fast IaroslavElistratov/gpu-kernel-engineering is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 26 – Oct 22, 2026

Stars +8 in 58 days

012
2

Forks +6 in 58 days

012
2

Merged PRs 0 in 58 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 in Cuda

151813211111
Aug 26Sep 3Sep 11Sep 19Sep 27Oct 5Oct 13Oct 21
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsCuda
Wed, Aug 26, 2026+0+00Not trending
Thu, Aug 27, 2026+0+00Not trending
Fri, Aug 28, 2026+0+10Not trending
Sat, Aug 29, 2026+0+00Not trending
Sun, Aug 30, 2026+0+00Not trending
Mon, Aug 31, 2026+0+10Not trending
Tue, Sep 1, 2026+0+00Not trending
Wed, Sep 2, 2026+0+20Not trending
Thu, Sep 3, 2026+0+00Not trending
Fri, Sep 4, 2026+0+00Not trending
Sat, Sep 5, 2026+0+00Not trending
Sun, Sep 6, 2026+0+00Not trending
Mon, Sep 7, 2026+0+00Not trending
Tue, Sep 8, 2026+0+00Not trending
Wed, Sep 9, 2026+0+00Not trending
Thu, Sep 10, 2026+0+00Not trending
Fri, Sep 11, 2026+0+00Not trending
Sat, Sep 12, 2026+0+00Not trending
Sun, Sep 13, 2026+0+00Not trending
Mon, Sep 14, 2026+0+00Not trending
Tue, Sep 15, 2026+0+10Not trending
Wed, Sep 16, 2026+0+00Not trending
Thu, Sep 17, 2026+0+00Not trending
Fri, Sep 18, 2026+0+00Not trending
Sat, Sep 19, 2026+0+00Not trending
Sun, Sep 20, 2026+0+00Not trending
Mon, Sep 21, 2026+0+00Not trending
Tue, Sep 22, 2026+0+00Not trending
Wed, Sep 23, 2026+0+00Not trending
Thu, Sep 24, 2026+0+00Not trending
Fri, Sep 25, 2026+0+00Not trending
Sat, Sep 26, 2026+0+00Not trending
Sun, Sep 27, 2026+0+00Not trending
Mon, Sep 28, 2026+0+00Not trending
Tue, Sep 29, 2026+0+00Not trending
Wed, Sep 30, 2026+0+00Not trending
Thu, Oct 1, 2026+0+00Not trending
Fri, Oct 2, 2026+0+00Not trending
Sat, Oct 3, 2026+0+00Not trending
Sun, Oct 4, 2026+0+00Not trending
Mon, Oct 5, 2026+1+10#15
Tue, Oct 6, 2026+0+00Not trending
Wed, Oct 7, 2026+0+00Not trending
Thu, Oct 8, 2026+1+00#18
Fri, Oct 9, 2026+1+00#13
Sat, Oct 10, 2026+1+00#21
Sun, Oct 11, 2026+0+00Not trending
Mon, Oct 12, 2026+0+00Not trending
Tue, Oct 13, 2026+0+00Not trending
Wed, Oct 14, 2026+2+00#11
Thu, Oct 15, 2026+0+00Not trending
Fri, Oct 16, 2026+0+00Not trending
Sat, Oct 17, 2026+1+00#11
Sun, Oct 18, 2026+0+00Not trending
Mon, Oct 19, 2026+0+00Not trending
Tue, Oct 20, 2026+1+00Not trending
Wed, Oct 21, 2026+0+00Not trending
Thu, Oct 22, 2026+0+00Not trending
Total+8+60
  • 1#1 on the list
  • 7Rank that day
  • Not trending
  • Mentions and achievements

    Where people are talking about IaroslavElistratov/gpu-kernel-engineering, and every badge it has earned
    1. Oct 11 post
      • 105 % of FlashAttention-4 on average (prefill, bf16, causal, hd128, GQA)

        Read full on Reddit

        r/CUDA

    You might also like

    Repositories close to IaroslavElistratov/gpu-kernel-engineering
    FeaturedAdvertise to 180K+ monthly visitors
    ClawBench

    a benchmark for personal agents

    Busbar

    Control what AI can do before it acts

    Bifrost

    Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

    mlc-ai/modern-gpu-programming-for-mlsys

    HTML

    A tutorial on modern GPU programming for machine learning systems

    1.4k148

    xlite-dev/LeetCUDA

    Cuda

    An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.

    12.1k1.3k

    WingEdge777/vitamin-cuda

    Cuda

    🍎 One kernel a day keeps high latency away. A hands-on CUDA learning path featuring a rich collection of kernels, from the basics to peak performance, seamlessly integrated as PyTorch C++ extensions.

    22719

    BBuf/how-to-optim-algorithm-in-cuda

    Cuda

    how to optimize some algorithm in cuda.

    3.3k303

    Ajith-Kumar-Nelliparthi/Learning_CUDA_From_Scratch

    Cuda

    Exploring GPU programming with CUDA from fundamentals to advanced kernels.

    8810

    Infatoshi/cuda-course

    Cuda
    4.2k731

    gau-nernst/learn-cuda

    Cuda

    Learn CUDA with PyTorch

    51767

    Ammar-Alnagar/AI-Kernel-learning

    Python

    This comprehensive learning repository is designed to transform software engineers into expert AI kernel developers, focusing on the cutting-edge technologies required for developing high-performance GPU kernels using NVIDIA's latest architectures and libraries.

    8013

    pranjalssh/fast.cu

    Cuda

    Fastest kernels written from scratch

    62982