Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

mostlygeek/llama-swap

Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

Visit GitHub
Go
6.2k
572
56 contributors
MIT License
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast mostlygeek/llama-swap is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 5 – Nov 4, 2026

Stars +603 in 61 days

0102030
26

Forks +114 in 61 days

0246
6

Merged PRs 80 in 61 days

0510
7

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Sep 5, 2026+5+53
Sun, Sep 6, 2026+7+32
Mon, Sep 7, 2026+18+13
Tue, Sep 8, 2026+12+20
Wed, Sep 9, 2026+10+60
Thu, Sep 10, 2026+7+12
Fri, Sep 11, 2026+5+00
Sat, Sep 12, 2026+12+00
Sun, Sep 13, 2026+6+21
Mon, Sep 14, 2026+8+20
Tue, Sep 15, 2026+4+00
Wed, Sep 16, 2026+10+02
Thu, Sep 17, 2026+7+02
Fri, Sep 18, 2026+8+15
Sat, Sep 19, 2026+2+31
Sun, Sep 20, 2026+16+40
Mon, Sep 21, 2026+6+12
Tue, Sep 22, 2026+8+33
Wed, Sep 23, 2026+10+31
Thu, Sep 24, 2026+9+03
Fri, Sep 25, 2026+7+11
Sat, Sep 26, 2026+2+07
Sun, Sep 27, 2026+5+11
Mon, Sep 28, 2026+15+51
Tue, Sep 29, 2026+9+21
Wed, Sep 30, 2026+8+10
Thu, Oct 1, 2026+9+00
Fri, Oct 2, 2026+7+21
Sat, Oct 3, 2026+9+43
Sun, Oct 4, 2026+16+00
Mon, Oct 5, 2026+26+20
Tue, Oct 6, 2026+13+40
Wed, Oct 7, 2026+14+32
Thu, Oct 8, 2026+15+22
Fri, Oct 9, 2026+7+21
Sat, Oct 10, 2026+11+10
Sun, Oct 11, 2026+8+01
Mon, Oct 12, 2026+12+02
Tue, Oct 13, 2026+5+12
Wed, Oct 14, 2026+7+31
Thu, Oct 15, 2026+16+00
Fri, Oct 16, 2026+14+20
Sat, Oct 17, 2026+10+10
Sun, Oct 18, 2026+18+30
Mon, Oct 19, 2026+6+30
Tue, Oct 20, 2026+14+30
Wed, Oct 21, 2026+15+31
Thu, Oct 22, 2026+11+21
Fri, Oct 23, 2026+7+11
Sat, Oct 24, 2026+7+32
Sun, Oct 25, 2026+9+21
Mon, Oct 26, 2026+12+20
Tue, Oct 27, 2026+8+31
Wed, Oct 28, 2026+13+12
Thu, Oct 29, 2026+10+15
Fri, Oct 30, 2026+13+62
Sat, Oct 31, 2026+13+12
Sun, Nov 1, 2026+7+14
Mon, Nov 2, 2026+10+10
Tue, Nov 3, 2026+10+30
Wed, Nov 4, 2026+5+12
Total+603+11480
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Go

    Mar 7, 2025 – Oct 25, 2026#1 on 2 days

    #1#5#10#15#20#25
    Top 10
    Apr 2025JulOctJan 2026AprJulOct
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about mostlygeek/llama-swap, and every badge it has earned
    1. Oct 61 post

      • 不知道吧，模型不一定非要用别人的。有实力的就能让 AI 跑在你自己的机器上。🔥 下面这 10 个仓库涵盖：下载、推理、聊天、高并发服务、多模型热切换、家里组集群，本地跑模型要用的，基本都有对应项目。👇 1️⃣ Ollama（182.3k 星） 🔗 本地跑模型的默认入口，使用频率最高。一条命令拉取 Llama、DeepSeek、Gemma、Qwen，自动调用 Mac Metal、NVIDIA…

        Read full on X, posted by @denziideng

        @denziideng · x.com

    2. Oct 41 post

      • I mention it once a month or so, but going to mention it again because it's my favorite project. llama-swap is what I use 99% of the time for serving everything, every llm and even audio and tts.…

        Read full on X, posted by @loktar00

        @loktar00 · x.com

    3. 25 days earlier
    4. Sep 91 post

      • MiniCPM5-2B from @OpenBMB ships documented sampling settings with no repeat-penalty, and without it the model loops mid-thought on most tasks. adding one flag took Q4_K_M from 6.1 to 71.3 on…

        Read full on X, posted by @DogukanUrker

        @DogukanUrker · x.com

    5. Sep 81 post

      • Introducing Quartermaster, an open source local AI platform designed for ease of use that does not sacrifice customizability

        Read full on Reddit

        r/LLMObservability

    6. Sep 51 post

      • Qwen3.8-27B on a single RTX 3060. after weeks of testing quants and configs, this is where I'm stopping -- these two are my final builds for this card. 158K ctx at 22 tok/s, or 82K at 38 tok/s.…

        Read full on X, posted by @DogukanUrker

        @DogukanUrker · x.com

    7. Sep 33 posts

      • Introducing Quartermaster, an open source local AI platform designed for ease of use that does not sacrifice customizability

        Read full on Reddit

        r/coolgithubprojects

      • Introducing Quartermaster, an open source local AI platform designed for ease of use that does not sacrifice customizability

        Read full on Reddit

        r/LocalLLM

      • Introducing Quartermaster, an open source local AI platform designed for ease of use that does not sacrifice customizability

        Read full on Reddit

        r/LocalLLaMA

    8. Aug 281 post

      • LFM2.5-8B-A1B by @liquidai on a single 12GB RTX 3060. 800K total context across 25 parallel slots, 398 tok/s aggregate. five benchmarks, one repair attempt each. (config below) IFEval 91.9. Liquid's…

        Read full on X, posted by @DogukanUrker

        @DogukanUrker · x.com

    9. 28 days earlier
    10. Jul 311 post

      • Running Qwen3.5-9B with MTP on a single RTX 3060. 12GB VRAM. 9B params. 230K context. ~67 tok/s, ~1500 tok/s prefill. zero CPU offload, all GPU the n-max part: everyone raises --spec-draft-n-max to…

        Read full on X, posted by @DogukanUrker

        @DogukanUrker · x.com

    You might also like

    Repositories close to mostlygeek/llama-swap
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    llamastash/llamastash

    Rust

    Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.

    28324

    atuinsh/atuin-ai-server

    Elixir

    Self-hosted server for Atuin AI, backed by any OpenAI-compatible endpoint

    957

    open-webui/open-webui

    Python

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    157.8k24.2k

    machaao/llama-net

    Python

    Turn any Mac or GPU into an OpenAI-compatible inference node. One-command setup, automatic HTTPS, model management, and distributed request routing.

    26

    theiskaa/hedos

    Rust

    Run and serve local models headlessly

    56

    donvito/ai-backends

    HTML

    API server runtime for common AI use cases — supports multiple models and providers. Run locally with Ollama or LM Studio, or in the cloud via OpenRouter, OpenAI, Anthropic, or Google.

    14615

    xorbitsai/inference

    Python

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

    9.6k935

    sunwu51/nanollm

    TypeScript

    llm api gateway

    5110

    DevXT-LLC/ezlocalai

    C++

    ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.

    9920