Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Busbar
Busbar
AxiomCode
AxiomCode
Bifrost
Bifrost

xberg-io/crawlberg

High-performance web crawling engine with bindings for 11 languages

#Web scraping
Visit GitHub
Rust
186
31
9 contributors
MIT License
website
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast xberg-io/crawlberg is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 21 – Oct 19, 2026

Stars +31 in 60 days

012
2

Forks +5 in 60 days

012
2

Merged PRs 165 in 60 days

0102030
24

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 21Aug 29Sep 6Sep 14Sep 22Sep 30Oct 8Oct 16
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Aug 21, 2026+1+00
Sat, Aug 22, 2026+1+00
Sun, Aug 23, 2026+1+00
Mon, Aug 24, 2026+1+00
Tue, Aug 25, 2026+0+00
Wed, Aug 26, 2026+0+00
Thu, Aug 27, 2026+2+00
Fri, Aug 28, 2026+1+00
Sat, Aug 29, 2026+0+00
Sun, Aug 30, 2026+0+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+0+00
Wed, Sep 2, 2026+1+00
Thu, Sep 3, 2026+2+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+1+00
Mon, Sep 7, 2026+0+10
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+2+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+1+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+2+00
Tue, Sep 15, 2026+1+00
Wed, Sep 16, 2026+2+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+1+03
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+20
Tue, Sep 22, 2026+1+00
Wed, Sep 23, 2026+1+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+12
Sat, Sep 26, 2026+0+07
Sun, Sep 27, 2026+0+015
Mon, Sep 28, 2026+2+020
Tue, Sep 29, 2026+0+024
Wed, Sep 30, 2026+0+014
Thu, Oct 1, 2026+0+04
Fri, Oct 2, 2026+0+06
Sat, Oct 3, 2026+1+06
Sun, Oct 4, 2026+1+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+1+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+2+15
Sun, Oct 11, 2026+0+013
Mon, Oct 12, 2026+0+017
Tue, Oct 13, 2026+0+016
Wed, Oct 14, 2026+1+05
Thu, Oct 15, 2026+0+08
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+1+00
Mon, Oct 19, 2026+0+00
Total+31+5165
  • 1#1 on the list
  • 7Rank that day
  • Not trending

Social mentions

Recent discussions about this repository across the web
  1. Jul 51 post

    • crawlberg: an MIT crawl-and-scrape engine that outputs clean Markdown + structured data for RAG

      Read full on Reddit

      r/Rag

  2. Jul 11 post

    • Introducing H2M, Crawlberg, TSLP, LiterLLM and the upcoming Xberg release

      Read full on Reddit

      r/dartlang

You might also like

Repositories close to xberg-io/crawlberg
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

fastcrw/crw

Rust

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

1.2k107

0xMassi/webclaw

Rust

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

2.4k266

Anakin-Inc/anakin

Go

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

4.5k305

lumpinif/deepcrawl

TypeScript

100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

69085

unclecode/crawl4ai

Python

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

85.8k9.2k

xcrawl-api/xcrawl-skills

Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

44943

oxylabs/ai-crawler-py

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

3.3k12

stretchcloud/deepscrape

TypeScript
32827

D4Vinci/Scrapling

Python

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

88.5k9.5k