Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Trina AX
Trina AX
OfinTech Desk
OfinTech Desk
Bifrost
Bifrost
Omnigraph
Omnigraph
It's a plan
It's a plan

ShayanTalaei/SpeculativeSelfDistillation

Speculative Self-Distillation enables Efficient Knowledge Internalization (NeurIPS 2026)

#LLM training
Visit GitHub
Python
25
3
4 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Trina AX

A self-hosted team AI workspace for company files, with per-person folder permissions

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Momentum

How fast ShayanTalaei/SpeculativeSelfDistillation is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Nov 11 – Nov 22, 2026

Stars +23 in 12 days

0510
10

Forks +3 in 12 days

01
1

Merged PRs 0 in 12 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Nov 11Nov 13Nov 15Nov 17Nov 19Nov 21
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+3+10
Fri, Nov 13, 2026+7+10
Sat, Nov 14, 2026+10+10
Sun, Nov 15, 2026+0+00
Mon, Nov 16, 2026+0+00
Tue, Nov 17, 2026+0+00
Wed, Nov 18, 2026+1+00
Thu, Nov 19, 2026+0+00
Fri, Nov 20, 2026+1+00
Sat, Nov 21, 2026+0+00
Sun, Nov 22, 2026+1+00
Total+23+30
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Nov 121 post
    • Models keep running into knowledge they weren't trained on: private documents, fresh facts, new domains. Keeping it all in text-based memories gets slower as it grows, and the model gets less sharp…

      Read full on X, posted by @talaei_shayan

      @talaei_shayan · x.com

You might also like

Repositories close to ShayanTalaei/SpeculativeSelfDistillation
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Trina AX

A self-hosted team AI workspace for company files, with per-person folder permissions

siyan-zhao/OPSD

Python
72062

modelscope/easydistill

Python

a toolkit on knowledge distillation for large language models

48949

songmzhang/KDFlow

Python

A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, full vocab on-policy (OPD), cross-tokenizer, multimodal, and on-policy self-distillation.

25623

bingreeky/LOPD

Python

Latent On-Policy Self-Distillation

632

arcee-ai/DistillKit

Python

An Open Source Toolkit For LLM Distillation

1.1k148

QwenApp/SpecOPD

SpecOPD: Branch-parallel on-policy distillation for faster speculative decoding.

302

Simplified-Reasoning/Draft-OPD

Python

The official repo of "Draft-OPD: On-Policy Distillation for Speculative Draft Models"

868

DripNowhy/On-Policy-Self-Adaptation

Python

Implementation of "Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement"

572

jwkirchenbauer/mtp-lm

Python

Source code to accompany research paper on training multi token prediction language models using self-distillation.

426