Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Bifrost
Bifrost
Omnigraph
Omnigraph
It's a plan
It's a plan
OfinTech Desk
OfinTech Desk

raketenkater/ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

#LLM inference
Visit GitHub
Go
285
21
3 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Momentum

How fast raketenkater/ggrun is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 20 – Nov 19, 2026

Stars +11 in 61 days

012
2

Forks +2 in 61 days

01
1

Merged PRs 73 in 61 days

0102030
27

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 20Sep 28Oct 6Oct 14Oct 22Oct 30Nov 7Nov 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+01
Wed, Sep 23, 2026+2+04
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+2+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+05
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+10
Fri, Oct 2, 2026+1+01
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+02
Wed, Oct 14, 2026+0+06
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+01
Sun, Oct 18, 2026+0+03
Mon, Oct 19, 2026+1+00
Tue, Oct 20, 2026+0+12
Wed, Oct 21, 2026+1+03
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+01
Tue, Oct 27, 2026+0+00
Wed, Oct 28, 2026+0+07
Thu, Oct 29, 2026+0+05
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+1+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+01
Thu, Nov 5, 2026+0+00
Fri, Nov 6, 2026+0+04
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+1+00
Tue, Nov 10, 2026+0+00
Wed, Nov 11, 2026+0+00
Thu, Nov 12, 2026+0+00
Fri, Nov 13, 2026+0+00
Sat, Nov 14, 2026+0+00
Sun, Nov 15, 2026+0+00
Mon, Nov 16, 2026+1+00
Tue, Nov 17, 2026+0+027
Wed, Nov 18, 2026+0+00
Thu, Nov 19, 2026+0+00
Total+11+273
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 41 post
    • Mismatched GPUs were my excuse for never running big MoE models locally. ggrun reads the GGUF's tensor layout against the VRAM, RAM and PCIe bandwidth actually in the box, checks the split fits…

      Read full on X, posted by @sunsetsyntax

      @sunsetsyntax · x.com

  2. 3 months earlier
  3. Jun 261 post
    • Llama.cpp flags auto-tuning tool

      Read full on Hacker News

      Hacker News

  4. Jun 231 post
    • Ggrun v3 is 65% faster than Ollama

      Read full on Hacker News

      Hacker News

You might also like

Repositories close to raketenkater/ggrun
FeaturedAdvertise to 180K+ monthly visitors
OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

TRI-Tech-Revolution-Intelligence/LocalLLM

TypeScript

Easily run LLMs locally using llama.cpp directly, without overhead.

213

kyuz0/llama-toolboxes-cockpit

Python
11114

dadwritestech/LlamaForge

Python

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.

12721

jimdawdy-hub/Local-LLM-Launcher-GUI

Python

A friendly GUI for running local LLMs with vLLM and llama.cpp — hardware-aware traffic-light guidance for every setting. Built on ideas from vllm-cli (Chen-zexi).

486

affifuddin-hazam/ghost-infer

HTML

Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.

24216

Tiiny-AI/PowerInfer

C++

High-speed Large Language Model Serving for Local Deployment

9.9k667

jitllm/jitllm

Go

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

586

ddh0/easy-llama

Python

Python package wrapping llama.cpp for on-device LLM inference

1067

AlexsJones/llmserve

Rust

A simple TUI for serving local LLM models. Pick a model, pick a backend, serve it

42528