Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Omnigraph
Omnigraph
Busbar
Busbar
Websitebench
Websitebench
Bifrost
Bifrost

RunanywhereAI/trnrt

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

#LLM inference
Visit GitHub
Python
636
2
3 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast RunanywhereAI/trnrt is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Nov 3 – Nov 10, 2026

Stars +640 in 8 days

0200400
365

Forks +2 in 8 days

012
2

Merged PRs 16 in 8 days

0246
6

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Nov 3Nov 4Nov 5Nov 6Nov 7Nov 8Nov 9Nov 10
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Tue, Nov 3, 2026+0+03
Wed, Nov 4, 2026+5+05
Thu, Nov 5, 2026+1+00
Fri, Nov 6, 2026+1+00
Sat, Nov 7, 2026+0+22
Sun, Nov 8, 2026+3+06
Mon, Nov 9, 2026+265+00
Tue, Nov 10, 2026+365+00
Total+640+216
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Nov 41 post
    • Each GLM-5.3-Flash layer used to run as a chain of small kernels with compiler glue in between. We rewrote every layer as combination of two megakernels making it 3.66x faster

      Read full on X, posted by @RunAnywhereAI

      @RunAnywhereAI · x.com

You might also like

Repositories close to RunanywhereAI/trnrt
FeaturedAdvertise to 180K+ monthly visitors
Websitebench

Can AI agents reverse-engineer real websites?

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Busbar

Control what AI can do before it acts

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

BerriAI/litellm

Python

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

63k13.8k

theroyallab/tabbyAPI

Python

The official API server for Exllama. OAI compatible, lightweight, and fast.

1.5k235

huggingface/text-generation-inference

Python

Large Language Model Text Generation Inference

10.9k1.3k

rogerai-fyi/roger

Go

RogerAI - a two-way radio for GPUs: a marketplace for self-hosted LLMs (CLI + broker + site).

1782

vllm-project/vllm-neuron

Python

Community maintained hardware plugin for vLLM on AWS Neuron

6148

huggingface/optimum-neuron

Jupyter Notebook

Training and inference on AWS Trainium and Inferentia chips.

27196

sqliteai/warp

C

Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.

2.5k207

geniusrise/geniusrise

Go

Geniusrise: Framework for building geniuses

625

dphnAI/sonar

Python

Large-scale LLM inference engine

1.9k212