Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
Busbar
Busbar

ArtificialAnalysis/aa-agentperf-local

Benchmark local LLM serving by replaying real agent trajectories

#LLM evaluation
Visit GitHub
Python
108
4
3 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast ArtificialAnalysis/aa-agentperf-local is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 27 – Oct 21, 2026

Stars +82 in 25 days

02040
32

Forks +4 in 25 days

012
2

Merged PRs 35 in 25 days

051015
11

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 27Oct 1Oct 5Oct 9Oct 13Oct 17Oct 21
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 27, 2026+0+03
Mon, Sep 28, 2026+0+010
Tue, Sep 29, 2026+0+011
Wed, Sep 30, 2026+32+02
Thu, Oct 1, 2026+11+10
Fri, Oct 2, 2026+5+00
Sat, Oct 3, 2026+2+00
Sun, Oct 4, 2026+4+00
Mon, Oct 5, 2026+3+00
Tue, Oct 6, 2026+1+01
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+2+00
Fri, Oct 9, 2026+1+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+00
Tue, Oct 13, 2026+2+00
Wed, Oct 14, 2026+1+00
Thu, Oct 15, 2026+6+08
Fri, Oct 16, 2026+3+00
Sat, Oct 17, 2026+3+10
Sun, Oct 18, 2026+1+20
Mon, Oct 19, 2026+2+00
Tue, Oct 20, 2026+1+00
Wed, Oct 21, 2026+0+00
Total+82+435
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Oct 151 post

    • We are also testing more weight formats and runtimes, including smaller 4-bit formats such as IQ4_XS and Inco AI's Splash, a Metal engine for Apple Silicon that uses DFlash speculative decoding. We…

      Read full on X, posted by @ArtificialAnlys

      @ArtificialAnlys · x.com

  2. 15 days earlier
  3. Sep 303 posts

    • benchmark your local box on real agent traffic, not a chat prompt. Artificial Analysis open-sourced aa-agentperf-local. it replays 8 recorded agent tasks (168 turns, largest one ~58K tokens) against…

      Read full on X, posted by @gitpulled

      @gitpulled · x.com

    • AA-AgentPerf-Local (Apache-2.0, from Artificial Analysis) replays real agent sessions against any OpenAI-compatible server you run. AA's first runs: DGX Spark vs Ryzen AI Halo at the same $4,000…

      Read full on X, posted by @jimmy_longbow_

      @jimmy_longbow_ · x.com

    • AA-AgentPerf-Local and the Laptops & Workstations page will be frequently updated as relevant new hardware and software becomes available. We are planning to implement a range of additional features…

      Read full on X, posted by @ArtificialAnlys

      @ArtificialAnlys · x.com

You might also like

Repositories close to ArtificialAnalysis/aa-agentperf-local
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

gengchaogit/llm_speedtest

HTML

Local LLM Inference Speed Test Tool

24320

aidatatools/ollama-benchmark

Python

LLM Benchmark for Throughput via Ollama (Local LLMs)

39749

fw-ai/benchmark

Python

Benchmark suite for LLMs from Fireworks.ai

11736

vllm-project/guidellm

Python

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

1.7k269

huggingface/inference-benchmarker

Rust

Inference server benchmarking tool

17633

SeraphimSerapis/tool-eval-bench

Python

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

39456

Yoosu-L/llmapibenchmark

Go

The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoints across different concurrency levels.

10420

stevibe/BenchLocal

TypeScript

Test LLMs on real tasks. Compare models side-by-side.

43054

eugr/llama-benchy

Python

llama-benchy - llama-bench style benchmarking tool for all backends

76281