Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Omnigraph
Omnigraph
Busbar
Busbar
Bifrost
Bifrost
Websitebench
Websitebench

apify/crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

#Web scraping
Visit GitHub
Python
9.7k
860
49 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Websitebench

Can AI agents reverse-engineer real websites?

Momentum

How fast apify/crawlee-python is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 16 – Nov 15, 2026

Stars +153 in 61 days

0510
7

Forks +34 in 61 days

0246
5

Merged PRs 159 in 61 days

01020
19

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 16Sep 24Oct 2Oct 10Oct 18Oct 26Nov 3Nov 11
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Sep 16, 2026+4+05
Thu, Sep 17, 2026+3+00
Fri, Sep 18, 2026+6+10
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+3+11
Tue, Sep 22, 2026+1+13
Wed, Sep 23, 2026+3+10
Thu, Sep 24, 2026+0+07
Fri, Sep 25, 2026+1+01
Sat, Sep 26, 2026+4+00
Sun, Sep 27, 2026+5+10
Mon, Sep 28, 2026+4+00
Tue, Sep 29, 2026+3+16
Wed, Sep 30, 2026+7+10
Thu, Oct 1, 2026+2+02
Fri, Oct 2, 2026+2+02
Sat, Oct 3, 2026+0+10
Sun, Oct 4, 2026+2+00
Mon, Oct 5, 2026+0+06
Tue, Oct 6, 2026+3+04
Wed, Oct 7, 2026+4+00
Thu, Oct 8, 2026+2+03
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+2+00
Sun, Oct 11, 2026+1+11
Mon, Oct 12, 2026+2+12
Tue, Oct 13, 2026+1+115
Wed, Oct 14, 2026+5+05
Thu, Oct 15, 2026+3+04
Fri, Oct 16, 2026+1+11
Sat, Oct 17, 2026+1+00
Sun, Oct 18, 2026+2+00
Mon, Oct 19, 2026+7+02
Tue, Oct 20, 2026+2+02
Wed, Oct 21, 2026+6+14
Thu, Oct 22, 2026+2+00
Fri, Oct 23, 2026+0+01
Sat, Oct 24, 2026+5+30
Sun, Oct 25, 2026+4+00
Mon, Oct 26, 2026+2+15
Tue, Oct 27, 2026+2+03
Wed, Oct 28, 2026+4+12
Thu, Oct 29, 2026+0+13
Fri, Oct 30, 2026+2+14
Sat, Oct 31, 2026+1+03
Sun, Nov 1, 2026+1+00
Mon, Nov 2, 2026+1+011
Tue, Nov 3, 2026+4+07
Wed, Nov 4, 2026+5+20
Thu, Nov 5, 2026+4+18
Fri, Nov 6, 2026+3+019
Sat, Nov 7, 2026+2+00
Sun, Nov 8, 2026+0+00
Mon, Nov 9, 2026+1+53
Tue, Nov 10, 2026+4+13
Wed, Nov 11, 2026+7+42
Thu, Nov 12, 2026+1+08
Fri, Nov 13, 2026+0+11
Sat, Nov 14, 2026+5+00
Sun, Nov 15, 2026+1+00
Total+153+34159
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

GitHub trending history

Where the repository ranked on GitHub Trending, one dot for each day it was on a list

Jul 12 – Jul 16, 2024Best #2

#1#5#10#15#20#25
Top 10
Aug 2024NovFebMayAugNovFeb
The left and right arrow keys step from day to day; Home and End go to the first and the last

Mentions and achievements

Where people are talking about apify/crawlee-python, and every badge it has earned
  1. Jul 61 post

    • 🐍 crawlee-python ⭐ 9,283 stars **"Librairie puissante pour automatiser le scraping et les navigateurs web !"** 🚀 *(Ou, si tu... #GitHub

      Read full on X, posted by @clxymox

      @clxymox · x.com

  2. 26 days earlier
  3. Jun 101 post

    • apify/crawlee-python: Crawlee—A web scraping and browser automation library for Python to build... - Extract data for AI, LLMs, RAG, or GPTs - Download HTML, PDF, JPG, PNG, and other files from…

      Read full on X, posted by @CanteLabs

      @CanteLabs · x.com

You might also like

Repositories close to apify/crawlee-python
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Websitebench

Can AI agents reverse-engineer real websites?

omkarcloud/botasaurus

TypeScript

The All in One Framework to Build Undefeatable Scrapers

5.8k520

apify/crawlee

TypeScript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

26.4k1.8k

scrapfly/python-scrapfly

Python

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

6317

apify/apify-sdk-python

Python

Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.

18036

D4Vinci/Scrapling

Python

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

103.1k11.2k

alirezamika/autoscraper

Python

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

8.1k852

brightdata/sdk-python

Python

Bright Data's python SDK, use it to call bright data's scrape and search tools. bypass any Bot-detection or Captcha and extract data from any website in seconds.

10028

mldsveda/PyScrappy

Python

Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.

26592

scrapy-plugins/scrapy-playwright

Python

🎭 Playwright integration for Scrapy

1.5k172