Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

leochlon/secant

RoPE attention is an exact forward-pass gradient step with softmax intact

Visit GitHub
Jupyter Notebook
57
3
1 contributors
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast leochlon/secant is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +11 in 61 days

024
4

Forks +3 in 61 days

01
1

Merged PRs 0 in 61 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+0+10
Mon, Sep 7, 2026+0+10
Tue, Sep 8, 2026+4+00
Wed, Sep 9, 2026+2+00
Thu, Sep 10, 2026+0+10
Fri, Sep 11, 2026+1+00
Sat, Sep 12, 2026+2+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+2+00
Tue, Sep 15, 2026+0+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+0+00
Total+11+30
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 81 post

    • derivatives. how related to LLMs and positional encoding? research from Chlon and team at Oxford proposes: - softmax attn = single step down a gradient, exact - ctx tokens can be compiled to a fixed…

      Read full on X, posted by @jrose2000

      @jrose2000 · x.com

  2. Sep 71 post

    • what if KV cache is optional? that's the impl of research by @leon_chlon and team at Oxford. follow along for part 2 of a linux PCI engineer bulldozes through a dense ML paper. "RoPE attention is an…

      Read full on X, posted by @jrose2000

      @jrose2000 · x.com

You might also like

Repositories close to leochlon/secant
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

lucidrains/taylor-series-linear-attention

Python

Explorations into the recently proposed Taylor Series Linear Attention

1023

apple-aiml-research/ml-sigma-reparam

Python
31414

Brainchip-Inc/Do-Transformers-Need-3-Projections

Python
498

ZacharyMeng/PolaFormer

Python

Official repository of Polarity-aware Linear Attention for Vision Transformers (ICLR 2025)

9110

SingleZombie/LLSA

Python

[CVPR 2026 Highlight] Official implementation of Log-linear Sparse Attention (LLSA).

943

tensorgi/TPA

Python

[NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (https://arxiv.org/abs/2501.06425)

46441

4rtemi5/ssog

Python

SSOG-Attention: Near-linear Visual-Attention and competitive results on ImageNet.

434

skylight-org/skylight-research

Python

Advancing the frontier of efficient AI

7016

thu-ml/SLA

Python

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

55223