Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

embeddings-benchmark/embedders-dilemma

Code, datasets, and results for "The Embedder's Dilemma: LLMs Are Better, but at What Cost?" (COLM 2026). MTEB(LLM) benchmarks 10 LLMs and 26 embedding models on 37 tasks with full cost and throughput accounting.

#LLM evaluation
Visit GitHub
Python
41
1
3 contributors
Apache License 2.0
website
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast embeddings-benchmark/embedders-dilemma is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 30 – Oct 27, 2026

Stars +17 in 59 days

012
2

Forks +0 in 59 days

01

Merged PRs 0 in 59 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 30Sep 7Sep 15Sep 23Oct 1Oct 9Oct 17Oct 25
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Aug 30, 2026+1+00
Mon, Aug 31, 2026+1+00
Tue, Sep 1, 2026+2+00
Wed, Sep 2, 2026+0+00
Thu, Sep 3, 2026+1+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+0+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+1+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+1+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+2+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+1+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+1+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+1+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+1+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+1+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+0+00
Fri, Oct 23, 2026+1+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+00
Total+17+00
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Aug 191 post

    • We call this the Embedder’s Dilemma. LLMs now match the best embedding models but at much higher cost and lower throughput. We study how this tradeoff changes across different task types.

      Read full on X, posted by @AdnanElAssadi

      @AdnanElAssadi · x.com

You might also like

Repositories close to embeddings-benchmark/embedders-dilemma
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

embeddings-benchmark/results

Python

Data for the MTEB leaderboard

65217

embeddings-benchmark/mteb

Python

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

3.5k753

huggingface/sentence-transformers

Python

State-of-the-Art Embeddings, Retrieval, and Reranking

19.2k3k

ibm-granite/granite-embedding-models

Jupyter Notebook
856

McGill-NLP/llm2vec

Python

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

1.7k140

MinishLab/model2vec

Python

Fast State-of-the-Art Static Embeddings

2.3k129

codefuse-ai/CodeFuse-Embeddings

Python

Text and code embeddings research from CodeFuse: C2LLM, D2LLM, E2LLM, F2LLM, ML-Embed

57779

FlagOpen/FlagEmbedding

Python

Retrieval and Retrieval-augmented LLMs

12.3k1.1k

open-compass/opencompass

Python

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

7.6k910