Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

EldanRing/winnow-inference

Local typed decisions, chat and vision with Winnow-12B and llama.cpp

#LLM inference
Visit GitHub
Python
28
4
1 contributors
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast EldanRing/winnow-inference is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 20 – Nov 5, 2026

Stars +29 in 47 days

024
4

Forks +4 in 47 days

01
1

Merged PRs 0 in 47 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 20Sep 26Oct 2Oct 8Oct 14Oct 20Oct 26Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+3+00
Mon, Sep 28, 2026+3+00
Tue, Sep 29, 2026+4+00
Wed, Sep 30, 2026+1+00
Thu, Oct 1, 2026+4+00
Fri, Oct 2, 2026+3+10
Sat, Oct 3, 2026+3+10
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+1+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+1+00
Sat, Oct 10, 2026+1+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+10
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+1+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+10
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+1+00
Thu, Nov 5, 2026+0+00
Total+29+40
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Sep 241 post

    • The speed gain is why I wanted this version. E4B Q8 reached 148 decisions/s versus 67 for Winnow-12B Q8, with 64 questions per request. About 2.2x the throughput and 5.46 GiB less VRAM. Measured on…

      Read full on X, posted by @EldanRing

      @EldanRing · x.com

  2. Sep 211 post

    • On my RTX 5070 Ti, Q8: 64K + vision, 15.01 GiB peak GPU memory. 55.5 tok/s short-prompt generation. 46.9 tok/s with a 62K multimodal prompt. Four decisions over the populated 64K vision fixture: 143…

      Read full on X, posted by @EldanRing

      @EldanRing · x.com

You might also like

Repositories close to EldanRing/winnow-inference
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

GreenBitAI/gbx-lm

Python

Run GreenBitAI's Quantized LLMs on Apple Devices with MLX

1342

incoai/splash

C++

A local inference engine for Apple silicon, built around the model.

2.1k191

TheStageAI/edge-lm

Python

Tiny llms optimised for edge deployment

1033

aweussom/NoLlama

Python

NPU Ollama - An Ollama/OpenAI compatible API for Intel OpenVINO compatible computers

13221

hebrus-labs/hebrus

C

Metal-first MoE inference for Apple Silicon with bounded SSD expert streaming and local OpenAI Chat, Responses, and Anthropic Messages endpoints.

679

jjang-ai/vmlx

Python

vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

909110

basecompute/baseRT

Rust

Fastest LLM inference runtime for Apple Silicon

24521

nace-ai/kapitsa

C++

Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai

64596

pytorch/torchchat

Python

Run PyTorch LLMs locally on servers, desktop and mobile

3.6k247