Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost
Busbar
Busbar

commoncrawl/news-crawl

News crawling with StormCrawler - stores content as WARC

#Web scraping
Visit GitHub
Java
380
42
8 contributors
Apache License 2.0
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

Momentum

How fast commoncrawl/news-crawl is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 28 – Oct 18, 2026

Stars +5 in 52 days

01
1

Forks +0 in 52 days

01

Merged PRs 6 in 52 days

0246
5

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 28Sep 4Sep 11Sep 18Sep 25Oct 2Oct 9Oct 16
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Fri, Aug 28, 2026+0+00
Sat, Aug 29, 2026+0+00
Sun, Aug 30, 2026+0+00
Mon, Aug 31, 2026+0+00
Tue, Sep 1, 2026+0+00
Wed, Sep 2, 2026+0+01
Thu, Sep 3, 2026+0+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+0+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+00
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+1+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+1+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+1+00
Wed, Sep 30, 2026+0+05
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+1+00
Sat, Oct 3, 2026+0+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+00
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+1+00
Sun, Oct 18, 2026+0+00
Total+5+06
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to commoncrawl/news-crawl
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

fhamborg/news-please

Python

news-please - an integrated web crawler and information extractor for news that just works

2.5k456

flairNLP/fundus

Python

A very simple news crawler with a funny name

480112

fivefilters/ftr-site-config

Site-specific article extraction rules to aid content extractors, feed readers, and 'read later' applications.

482267

codelucas/newspaper

Python

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

15.2k2.1k

lewisdonovan/google-news-scraper

JavaScript

Lightweight scraper for Google News

38265

fabriziosalmi/UglyFeed

Python

Retrieve, aggregate, filter, evaluate, rewrite and serve RSS feeds using Large Language Models for fun, research and learning purposes

32119

DIYgod/RSSHub

TypeScript

🧡 Everything is RSSible

46.6k10.8k

watercrawl/WaterCrawl

TypeScript

Transform Web Content into LLM-Ready Data

2.2k286

babarot/oksskolten

TypeScript

🏔️ The AI-native RSS reader

49363