Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
AxiomCode
AxiomCode
Bifrost
Bifrost
Busbar
Busbar

defilantech/LLMKube

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

#Kubernetes
Visit GitHub
Go
236
57
9 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast defilantech/LLMKube is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 20 – Oct 19, 2026

Stars +43 in 61 days

0123
3

Forks +27 in 61 days

0510
7

Merged PRs 265 in 61 days

051015
15

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 20Aug 28Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Aug 20, 2026+0+16
Fri, Aug 21, 2026+1+01
Sat, Aug 22, 2026+0+04
Sun, Aug 23, 2026+0+03
Mon, Aug 24, 2026+2+09
Tue, Aug 25, 2026+1+04
Wed, Aug 26, 2026+0+08
Thu, Aug 27, 2026+0+07
Fri, Aug 28, 2026+0+015
Sat, Aug 29, 2026+0+02
Sun, Aug 30, 2026+1+01
Mon, Aug 31, 2026+0+03
Tue, Sep 1, 2026+3+015
Wed, Sep 2, 2026+0+02
Thu, Sep 3, 2026+1+02
Fri, Sep 4, 2026+3+03
Sat, Sep 5, 2026+0+12
Sun, Sep 6, 2026+0+10
Mon, Sep 7, 2026+1+01
Tue, Sep 8, 2026+0+11
Wed, Sep 9, 2026+1+00
Thu, Sep 10, 2026+0+16
Fri, Sep 11, 2026+0+06
Sat, Sep 12, 2026+0+05
Sun, Sep 13, 2026+0+02
Mon, Sep 14, 2026+1+014
Tue, Sep 15, 2026+0+02
Wed, Sep 16, 2026+1+09
Thu, Sep 17, 2026+0+02
Fri, Sep 18, 2026+0+02
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+12
Mon, Sep 21, 2026+0+010
Tue, Sep 22, 2026+1+04
Wed, Sep 23, 2026+0+02
Thu, Sep 24, 2026+2+16
Fri, Sep 25, 2026+0+07
Sat, Sep 26, 2026+2+00
Sun, Sep 27, 2026+2+06
Mon, Sep 28, 2026+3+05
Tue, Sep 29, 2026+3+07
Wed, Sep 30, 2026+1+05
Thu, Oct 1, 2026+3+00
Fri, Oct 2, 2026+0+02
Sat, Oct 3, 2026+0+03
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+2+00
Tue, Oct 6, 2026+1+12
Wed, Oct 7, 2026+0+09
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+10
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+1+16
Mon, Oct 12, 2026+0+17
Tue, Oct 13, 2026+2+012
Wed, Oct 14, 2026+1+04
Thu, Oct 15, 2026+0+17
Fri, Oct 16, 2026+0+48
Sat, Oct 17, 2026+0+49
Sun, Oct 18, 2026+2+75
Mon, Oct 19, 2026+0+00
Total+43+27265
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Jun 181 post

    • My local LLM lab has started improving itself. An agentic coder running on models I host on my own hardware (Apple Silicon + an AMD Strix Halo box), routed through a gateway, is now opening real PRs…

      Read full on X, posted by @defilan

      @defilan · x.com

  2. Jun 141 post

    • Closed out the "trustworthy fleet" milestone on LLMKube. The agents self-update now, validate at admission, and have e2e tests. Best part was writing one this morning and watching it catch a real bug…

      Read full on X, posted by @defilan

      @defilan · x.com

You might also like

Repositories close to defilantech/LLMKube
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

llm-d/llm-d

Python

Achieve state of the art inference performance with modern accelerators on Kubernetes

4.9k889

InftyAI/llmaz

Go

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

31547

llm-d/llm-d-router

Go

llm-d Router: The intelligent entry point for inference requests

422467

vllm-project/production-stack

Python

vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

2.7k531

nekomeowww/ollama-operator

Go

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

24228

scaleapi/llm-engine

Python

Scale LLM Engine public repository

83984

kubeai-project/kubeai

Go

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

1.3k145

vllm-project/aibrix

Go

Cost-efficient and pluggable Infrastructure components for GenAI inference

5.2k757

kaito-project/kaito

Go

Kubernetes AI Toolchain Operator

1k186