Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

0xMassi/webclaw

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

#Web scraping
Visit GitHub
Rust
2.4k
274
7 contributors
GNU Affero General Public License v3.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast 0xMassi/webclaw is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 6 – Nov 5, 2026

Stars +111 in 61 days

051015
14

Forks +27 in 61 days

024
4

Merged PRs 71 in 61 days

051015
12

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16Oct 24Nov 1
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sun, Sep 6, 2026+1+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+1+00
Wed, Sep 9, 2026+14+02
Thu, Sep 10, 2026+2+00
Fri, Sep 11, 2026+1+00
Sat, Sep 12, 2026+2+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+1+01
Tue, Sep 15, 2026+2+00
Wed, Sep 16, 2026+3+00
Thu, Sep 17, 2026+3+11
Fri, Sep 18, 2026+2+11
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+3+00
Tue, Sep 22, 2026+3+00
Wed, Sep 23, 2026+1+01
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+10
Sat, Sep 26, 2026+1+00
Sun, Sep 27, 2026+6+10
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+1+10
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+1+00
Sun, Oct 4, 2026+0+20
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+2+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+3+00
Fri, Oct 9, 2026+0+10
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+1+00
Mon, Oct 12, 2026+0+010
Tue, Oct 13, 2026+5+010
Wed, Oct 14, 2026+2+48
Thu, Oct 15, 2026+0+012
Fri, Oct 16, 2026+1+14
Sat, Oct 17, 2026+0+40
Sun, Oct 18, 2026+1+20
Mon, Oct 19, 2026+1+04
Tue, Oct 20, 2026+1+04
Wed, Oct 21, 2026+1+01
Thu, Oct 22, 2026+1+10
Fri, Oct 23, 2026+1+00
Sat, Oct 24, 2026+1+00
Sun, Oct 25, 2026+2+00
Mon, Oct 26, 2026+0+02
Tue, Oct 27, 2026+7+16
Wed, Oct 28, 2026+10+21
Thu, Oct 29, 2026+2+00
Fri, Oct 30, 2026+3+10
Sat, Oct 31, 2026+2+00
Sun, Nov 1, 2026+7+10
Mon, Nov 2, 2026+1+02
Tue, Nov 3, 2026+3+21
Wed, Nov 4, 2026+3+00
Thu, Nov 5, 2026+1+00
Total+111+2771
  • 1#1 on the list
  • 7Rank that day
  • Not trending

    • Mentions and achievements

    Where people are talking about 0xMassi/webclaw, and every badge it has earned
    1. Oct 161 post

      • webclaw on anthropic's tool-use docs today raw html: 441,584 tokens (o200k_base) --format llm: 3,724 99.2% cut. agent docs pages are mostly chrome; strip before you burn context on the sidebar

        Read full on X, posted by @0xMassi

        @0xMassi · x.com

    2. Oct 151 post

      • ran webclaw on 3 docs pages today, tiktoken o200k_base mdn fetch api: 41,256 raw tokens → 1,679 react useEffect: 199,808 → 10,145 next.js install: 250,437 → 3,134 95-99% of the bill was markup the…

        Read full on X, posted by @0xMassi

        @0xMassi · x.com

    3. Oct 142 posts

      • ran webclaw on the pypi page for requests raw html: 73,734 tokens --format llm: 12,227 same run with --include ".project-description": 1,936 7,724 of those llm tokens sat in a links list at the…

        Read full on X, posted by @0xMassi

        @0xMassi · x.com

      • ran webclaw on 3 public pages and counted tokens with tiktoken github repo page: 189,738 tokens of raw html, 5,190 after webclaw wikipedia article: 71,645 down to 12,647 python json docs: 32,574 down…

        Read full on X, posted by @0xMassi

        @0xMassi · x.com

    4. 23 days earlier
    5. Sep 211 post

      • I shipped a free tier on my Rust scrape API: 500 pages/mo, no card

        Read full on Reddit

        r/SideProject

    6. 19 days earlier
    7. Sep 21 post

      • webclaw v0.6.22 • Optional hosted model provider • No local inference probes on managed deployments • Encoded characters preserved in docs and sitemaps • Correct MCP pre-init errors • PDF header…

        Read full on X, posted by @webclaw_io

        @webclaw_io · x.com

    8. Aug 281 post

      • mcp-searxng (988★) Private web search for AI agents via SearXNG, Claude and MCP compatible. -> Give your Claude Code agents web search without sending queries to Google.

        Read full on X, posted by @MMIA18EMV

        @MMIA18EMV · x.com

    9. 7 days earlier
    10. Aug 211 post

      • 10 open source tools that feel illegal to be free 👇 1. Dither Kit - Crazy good dither charts and components 2. AI Stack - See exactly what real builders use to ship 3. Webclaw - Scrape anything 4.…

        Read full on X, posted by @orcdev

        @orcdev · x.com

    11. 7 days earlier
    12. Aug 141 post

      • Web scraping shouldn’t leave your AI agent cleaning raw HTML. webclaw is a local-first Rust toolkit that turns websites into clean markdown, JSON, and LLM-ready context for AI agents and RAG…

        Read full on X, posted by @DanKornas

        @DanKornas · x.com

    13. 1 month earlier
    14. Jul 141 post

      • We now cover scraping costs for open-source projects: 100k credits/month, no card, engine is AGPL

        Read full on Reddit

        r/WebScrapingInsider

    You might also like

    Repositories close to 0xMassi/webclaw
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    unclecode/crawl4ai

    Python

    Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

    86.9k9.4k

    YOLOW92/pagesift

    Rust

    High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG. Adaptive crawling, clean Markdown, structured data, PDF/RSS parsing, browser rendering, Firecrawl-compatible APIs, and Python/Node.js SDKs.

    20322

    GramosoftAI/GcrawlAI

    Python

    Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

    604

    fastcrw/crw

    Rust

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

    1.2k113

    Anakin-Inc/anakin

    Go

    Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

    3.9k307

    lumpinif/deepcrawl

    TypeScript

    100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

    69685

    watercrawl/WaterCrawl

    TypeScript

    Transform Web Content into LLM-Ready Data

    2.2k286

    xberg-io/crawlberg

    Rust

    Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

    19531

    BrowserCash/teracrawl

    TypeScript

    High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

    28936