Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

BuilderIO/gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL

#Web scraping
Visit GitHub
TypeScript
22.4k
2.4k
30 contributors
ISC License
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast BuilderIO/gpt-crawler is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +54 in 61 days

0246
5

Forks +11 in 61 days

01
1

Merged PRs 0 in 61 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+1+10
Mon, Sep 7, 2026+3+00
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+3+00
Fri, Sep 11, 2026+1+00
Sat, Sep 12, 2026+0+10
Sun, Sep 13, 2026+1+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+10
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+1+00
Sat, Sep 19, 2026+2+00
Sun, Sep 20, 2026+1+10
Mon, Sep 21, 2026+1+10
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+5+10
Thu, Sep 24, 2026+1+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+1+00
Sun, Sep 27, 2026+1+00
Mon, Sep 28, 2026+0+10
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+2+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+1+00
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+1+00
Wed, Oct 7, 2026+4+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+10
Tue, Oct 13, 2026+1+00
Wed, Oct 14, 2026+2+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+10
Sat, Oct 17, 2026+1+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Tue, Oct 20, 2026+2+00
Wed, Oct 21, 2026+0+10
Thu, Oct 22, 2026+1+00
Fri, Oct 23, 2026+2+00
Sat, Oct 24, 2026+0+00
Sun, Oct 25, 2026+1+10
Mon, Oct 26, 2026+0+00
Tue, Oct 27, 2026+1+00
Wed, Oct 28, 2026+2+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+3+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+1+00
Mon, Nov 2, 2026+3+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+3+00
Thu, Nov 5, 2026+0+00
Total+54+110
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Nov 17, 2023 – Jan 14, 2025#1 on 1 day

    #1#5#10#15#20#25
    Top 10
    Dec 2023FebAprJunAugOctDecFeb
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about BuilderIO/gpt-crawler, and every badge it has earned
    1. Oct 161 post

      • GitHub 上这个爆红的 GPT 专用爬虫脚本项目，简直是神器啊！ 30 秒就能搞定一个属于你的问答机器人，快速抓取网站内容 就像拥有个小助手，帮你快速搜罗网站的精华，统统放进一个Output.json文件里。然后一键上传到GPTS，机器人马上就能用 项目链接：

        Read full on X, posted by @SgLittlesmart

        @SgLittlesmart · x.com

    2. 2 months earlier
    3. Aug 71 post

      • gpt-crawler 是一个开源的网站爬虫工具，通过配置 URL 和 CSS 选择器即可爬取网页内容并生成知识文件（JSON），然后可将该文件上传到 OpenAI 来创建自定义 GPT 或自定义助手。 支持本地运行、Docker 部署和 API 模式，目前在 GitHub 上已获得超过 22,400 个星标。

        Read full on X, posted by @weiwei2018831

        @weiwei2018831 · x.com

    You might also like

    Repositories close to BuilderIO/gpt-crawler
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    AnkitNayak-dev/CrawlAI-RAG

    Python

    CrawlAI RAG is an AI-powered website intelligence platform that allows users to crawl entire websites, index their content, and ask natural-language questions using Retrieval-Augmented Generation (RAG). It transforms static websites into queryable knowledge bases.

    15542

    watercrawl/WaterCrawl

    TypeScript

    Transform Web Content into LLM-Ready Data

    2.2k286

    run-llama/rags

    Python

    Build ChatGPT over your data, all with natural language

    6.5k661

    opencx-labs/OpenChat

    JavaScript

    LLMs custom-chatbots console ⚡

    5.2k615

    GramosoftAI/GcrawlAI

    Python

    Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

    604

    firecrawl/web-agent

    TypeScript

    🔥 Open-source web data agent optimized for structured web research

    1.3k176

    unbrowse-ai/unbrowse

    TypeScript

    Unbrowse - Reverse engineer any website so that your agents can access its APIs directly

    89687

    developersdigest/llm-api-engine

    TypeScript

    Build and deploy AI-powered APIs in seconds

    74881

    goodnight000/api-anything

    TypeScript

    Turn any website into an API your agent can call. Learns from the site's own frontend, heals itself when the site changes.

    2.5k291