Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
AxiomCode
AxiomCode
Busbar
Busbar

commoncrawl/cc-pyspark

Process Common Crawl data with Python and Spark

#Learning resources
Visit GitHub
Python
459
97
10 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Busbar

Control what AI can do before it acts

Momentum

How fast commoncrawl/cc-pyspark is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 7 – Oct 19, 2026

Stars +3 in 43 days

01
1

Forks +2 in 43 days

01
1

Merged PRs 3 in 43 days

012
2

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 7Sep 13Sep 19Sep 25Oct 1Oct 7Oct 13Oct 19
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+02
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+00
Wed, Sep 16, 2026+1+00
Thu, Sep 17, 2026+0+11
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+1+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+1+10
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Total+3+23
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to commoncrawl/cc-pyspark
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Busbar

Control what AI can do before it acts

commoncrawl/cc-crawl-statistics

Python

Statistics of Common Crawl monthly archives mined from URL index files

23319

commoncrawl/cdx_toolkit

Python

A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine

21833

watercrawl/WaterCrawl

TypeScript

Transform Web Content into LLM-Ready Data

2.2k286

chrismattmann/sparkler

Python

A crawl workstation: View, Control, and Crawl. Solr CrawlDB, Tika, Vue 3.

419136

lumpinif/deepcrawl

TypeScript

100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

69085

duckduckgo/tracker-radar-collector

JavaScript

🕸 Modular, multithreaded, puppeteer-based crawler

16969

xcrawl-api/xcrawl-skills

Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

44943

ucbepic/docetl

Python

A system for agentic LLM-powered data processing and ETL

4.1k451

oxylabs/ai-crawler-py

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

3.3k12