Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Busbar
Busbar
Bifrost
Bifrost

tinyfish-io/bigset-oss

Open-source BigSet — self-hostable live datasets populated by TinyFish web agents

Visit GitHub
TypeScript
1.7k
214
13 contributors
GNU Affero General Public License v3.0
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast tinyfish-io/bigset-oss is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 10 – Nov 9, 2026

Stars +26 in 61 days

0123
3

Forks +6 in 61 days

012
2

Merged PRs 1 in 61 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 10Sep 18Sep 26Oct 4Oct 12Oct 20Oct 28Nov 5
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Sep 10, 2026+1+00
Fri, Sep 11, 2026+1+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+1+00
Tue, Sep 15, 2026+1+01
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+1+00
Fri, Sep 18, 2026+1+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+1+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+2+10
Thu, Sep 24, 2026+1+20
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+2+10
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+3+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+10
Sun, Oct 4, 2026+2+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+1+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+1+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+1+00
Thu, Oct 15, 2026+1+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+0+00
Wed, Oct 21, 2026+0+00
Thu, Oct 22, 2026+2+00
Fri, Oct 23, 2026+0+00
Sat, Oct 24, 2026+1+00
Sun, Oct 25, 2026+0+00
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+0+10
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Thu, Nov 5, 2026+1+00
Fri, Nov 6, 2026+0+00
Sat, Nov 7, 2026+0+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+0+00
Total+26+61
  • 1#1 on the list
  • 7Rank that day
  • Not trending
  • Mentions and achievements

    Where people are talking about tinyfish-io/bigset-oss, and every badge it has earned
    1. Jun 251 post
      • Build your own datasets with BigSet's auto-infered schema. See link below 👇

        Read full on X, posted by @RepoGems

        @RepoGems · x.com

    2. 13 days earlier
    3. Jun 121 post
      • My Hermes agent can now create LIVE datasets on the fly. Just added a real-time data layer to Hermes using the open-source TinyFish BigSet. First it builds the dataset. Then it finds the signal. This…

        Read full on X, posted by @Saboo_Shubham_

        @Saboo_Shubham_ · x.com

    4. Jun 92 posts
      • 想整理数据?批量找行业内的标准数据格式? 采集同类信息,以前你得一个个打开,找到并收集。或者你会自己做个爬虫工具一个个的采。 但是回来的内容需要你做二次处理和清洗才可以用。 并且采回来很多垃圾,没有做交叉验证,无法有效交付。 BigSet 这个开源项目,就能解决这个问题! 它的思路是: 你用一句话描述你想要什么数据, 它就自动去网上搜索、理解页面内容, 再帮你整理成一张干净的结构化表格。…

        Read full on X, posted by @binghe

        @binghe · x.com

      • BigSet hit 1.2k ⭐ and 50k+ fetches in a week 🤯 The one thing you kept telling us? Self-hosting was too hard. Fixed. Clone → make dev → API key in the UI → running. In case you're new to BigSet,…

        Read full on X, posted by @Tiny_Fish

        @Tiny_Fish · x.com

    5. Jun 51 post3 posts
      • POV: You built a cloud GPU price dataset yesterday using BigSet You come back today, hit "update dataset." The datset updates itself. Lambda A100: $1.69 → $1.99 ⬆️ GPU prices move every few hours.…

        Read full on X, posted by @Tiny_Fish

        @Tiny_Fish · x.com

      • This is worth trying. High quality web data on tap @Tiny_Fish

        Read full on X, posted by @sudheenair

        @sudheenair · x.com

      • 80+ B2B SaaS tool worth knowing that has a free tier. Across categories like accounting, analytics, CRM, and Design. What you get for free. Starting paid price. Summary. All in one spreadsheet. Built…

        Read full on X, posted by @Tiny_Fish

        @Tiny_Fish · x.com

    6. Jun 41 post
      • been playing around with bigset by @Tiny_Fish over the last few days. one of the recurring problems we've had is finding niche datasets that don't really exist in a clean format anywhere. the data is…

        Read full on X, posted by @MatthewGunnin

        @MatthewGunnin · x.com

    7. Jun 32 posts
      • Unstructured webpages of dealerships → structured data at scale. No scraping scripts, no manual work. Just BigSet!

        Read full on X, posted by @Tiny_Fish

        @Tiny_Fish · x.com

      • This is so cool, using BigSet to find all dealerships in my area. It can compile all dealerships in Cali with their names, inventory count, brands they carry and phone number.

        Read full on X, posted by @not_simantak

        @not_simantak · x.com

    You might also like

    Repositories close to tinyfish-io/bigset-oss
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Busbar

    Control what AI can do before it acts

    Oqura-ai/deepresearch-datagen-cli

    Python

    Using deep research workflow to generate datasets for finetuning LLMs.

    407

    firecrawl/open-agent-builder

    TypeScript

    🔥 Visual workflow builder for AI agents powered by Firecrawl - drag-and-drop web scraping pipelines with real-time execution

    2.7k529

    developersdigest/llm-api-engine

    TypeScript

    Build and deploy AI-powered APIs in seconds

    74881

    mengysun/DataParasite

    JavaScript

    A simple yet versatile context engineered for scalable online data collection

    1024

    parallel-web/parallel-web-tools

    Python

    Contains parallel-cli and the parallel-web-tools Python package. Built on the parallel-web SDK: https://github.com/parallel-web/parallel-sdk-python

    5211

    discourselab/scrapai-cli

    Python

    AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.

    11718

    PxyUp/fitter

    Go

    New way for collect information from the API's/Websites

    13310

    langchain-ai/data-enrichment

    Jupyter Notebook

    LangGraph Studio template for creating an agent that does web research to genearte or enrich structured data.

    25865

    tavily-ai/tavily-sheets

    TypeScript

    Pair Tavily search with an LLM to fill spreadsheet cells with web‑sourced insights and citations.

    5216