Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

kyegomez/SwitchTransformers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

Visit GitHub
Python
148
17
2 contributors
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast kyegomez/SwitchTransformers is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 9 – Nov 5, 2026

Stars +0 in 28 days

01

Forks +0 in 28 days

01

Merged PRs 0 in 28 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 9Oct 13Oct 17Oct 21Oct 25Oct 29Nov 2
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Total+0+00
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to kyegomez/SwitchTransformers
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

lucidrains/x-transformers

Python

A concise but complete full-attention transformer with a set of promising experimental features from various papers

6k529

apple-aiml-research/ml-sigma-reparam

Python
31414

chenjianyong909/Transformer_study

Jupyter Notebook
50

karpathy/minGPT

Python

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

25k3.3k

kyegomez/BitNet

Python

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

1.9k175

HKUSTDial/flash-sparse-attention

Python

Trainable fast and memory-efficient sparse attention

74555

raymin0223/mixture_of_recursions

Python

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation (NeurIPS 2025)

649104

fkodom/transformer-from-scratch

Python

Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch

9719

Brainchip-Inc/Do-Transformers-Need-3-Projections

Python
498