Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

projectdiscovery/katana

A next-generation crawling and spidering framework.

#Web scraping
Visit GitHub
Go
17.8k
1.3k
64 contributors
MIT License
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast projectdiscovery/katana is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 5 – Nov 4, 2026

Stars +409 in 61 days

0102030
24

Forks +147 in 61 days

0102030
26

Merged PRs 81 in 61 days

0510
10

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 in Go

25
Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15Oct 23Oct 31
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsGo
Sat, Sep 5, 2026+8+10Not trending
Sun, Sep 6, 2026+2+30Not trending
Mon, Sep 7, 2026+5+00Not trending
Tue, Sep 8, 2026+8+00Not trending
Wed, Sep 9, 2026+24+21#25
Thu, Sep 10, 2026+22+02Not trending
Fri, Sep 11, 2026+11+17Not trending
Sat, Sep 12, 2026+16+00Not trending
Sun, Sep 13, 2026+15+20Not trending
Mon, Sep 14, 2026+10+20Not trending
Tue, Sep 15, 2026+2+10Not trending
Wed, Sep 16, 2026+3+20Not trending
Thu, Sep 17, 2026+5+10Not trending
Fri, Sep 18, 2026+8+00Not trending
Sat, Sep 19, 2026+3+20Not trending
Sun, Sep 20, 2026+6+00Not trending
Mon, Sep 21, 2026+8+10Not trending
Tue, Sep 22, 2026+4+00Not trending
Wed, Sep 23, 2026+7+05Not trending
Thu, Sep 24, 2026+8+20Not trending
Fri, Sep 25, 2026+7+01Not trending
Sat, Sep 26, 2026+9+00Not trending
Sun, Sep 27, 2026+4+00Not trending
Mon, Sep 28, 2026+6+00Not trending
Tue, Sep 29, 2026+6+310Not trending
Wed, Sep 30, 2026+4+10Not trending
Thu, Oct 1, 2026+8+00Not trending
Fri, Oct 2, 2026+2+00Not trending
Sat, Oct 3, 2026+6+00Not trending
Sun, Oct 4, 2026+2+10Not trending
Mon, Oct 5, 2026+0+19Not trending
Tue, Oct 6, 2026+6+00Not trending
Wed, Oct 7, 2026+4+00Not trending
Thu, Oct 8, 2026+5+21Not trending
Fri, Oct 9, 2026+7+30Not trending
Sat, Oct 10, 2026+6+00Not trending
Sun, Oct 11, 2026+2+00Not trending
Mon, Oct 12, 2026+6+20Not trending
Tue, Oct 13, 2026+7+30Not trending
Wed, Oct 14, 2026+11+90Not trending
Thu, Oct 15, 2026+6+50Not trending
Fri, Oct 16, 2026+3+110Not trending
Sat, Oct 17, 2026+4+260Not trending
Sun, Oct 18, 2026+0+240Not trending
Mon, Oct 19, 2026+8+231Not trending
Tue, Oct 20, 2026+5+07Not trending
Wed, Oct 21, 2026+7+01Not trending
Thu, Oct 22, 2026+10+11Not trending
Fri, Oct 23, 2026+6+32Not trending
Sat, Oct 24, 2026+5+01Not trending
Sun, Oct 25, 2026+5+22Not trending
Mon, Oct 26, 2026+10+09Not trending
Tue, Oct 27, 2026+14+07Not trending
Wed, Oct 28, 2026+6+22Not trending
Thu, Oct 29, 2026+6+10Not trending
Fri, Oct 30, 2026+9+00Not trending
Sat, Oct 31, 2026+3+00Not trending
Sun, Nov 1, 2026+5+27Not trending
Mon, Nov 2, 2026+6+03Not trending
Tue, Nov 3, 2026+5+22Not trending
Wed, Nov 4, 2026+3+00Not trending
Total+409+14781
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1

    • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Jun 18 – Nov 19, 2024Best #10

    #1#5#10#15#20#25
    Top 10
    Feb 2024AugFebAugFebAug
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about projectdiscovery/katana, and every badge it has earned
    1. Sep 271 post

      • 1/10 — httpx GitHub: A fast HTTP probing tool for discovering live web servers. What it does: • Detects HTTP/HTTPS services • Identifies status codes and technologies • Extracts titles and response…

        Read full on X, posted by @NitinGavhane_

        @NitinGavhane_ · x.com

    2. 4 months earlier
    3. May 311 post

      • 🔥 9 GitHub repos that make web scraping dramatically easier. Most scrapers get blocked after a few requests. These projects help you crawl, extract, and structure data at scale: 1️⃣ Crawl4AI…

        Read full on X, posted by @FM_yassin

        @FM_yassin · x.com

    4. May 302 posts

      • Best GitHub repos to scrape any site without getting blocked: 1. Crawl4AI 2. Firecrawl 3. Scrapy 4. Crawlee 5. Playwright 6. Scrapegraph AI 7. Browser Use 8. Katana 9. Maxun

        Read full on X, posted by @itsharmanjot

        @itsharmanjot · x.com

      • 9 GITHUB REPOS THAT LET YOU SCRAPE ANY WEBSITE WITHOUT GETTING BLOCKED. Most scrapers get banned in the first 100 requests. These ones do not. Crawl4AI — AI-powered crawler built for LLM pipelines.…

        Read full on X, posted by @cyrilXBT

        @cyrilXBT · x.com

    5. May 291 post2 posts

      • When we created Katana, I think we may have just created the best crawling/spidering framework for hackers. ✅ Standard / Headless modes for better coverage on modern apps ✅ Customizable Config ✅…

        Read full on X, posted by @pdiscoveryio

        @pdiscoveryio · x.com

      • Most crawlers miss JavaScript-rendered pages. Katana finds them: recursive crawling with headless Chrome, automatic captcha solving for reCAPTCHA and Turnstile, fine-grained scope control.

        Read full on X, posted by @so_sthbryan

        @so_sthbryan · x.com

    6. May 273 posts

      • 9 GitHub repos that let you scrape almost any website without getting blocked 👇🔥 Most scrapers die after the first 100 requests. These don’t. 1. Crawl4AI AI-powered crawler built for LLM pipelines.…

        Read full on X, posted by @smratitiwa86867

        @smratitiwa86867 · x.com

      • 9 GITHUB REPOS THAT LET YOU SCRAPE ANY WEBSITE WITHOUT GETTING BLOCKED. Most scrapers get banned in the first 100 requests. These ones do not. Crawl4AI — AI-powered crawler built for LLM pipelines.…

        Read full on X, posted by @cyrilXBT

        @cyrilXBT · x.com

      • BEST GITHUB REPOS FOR SCRAPING SITES WITHOUT GETTING BLOCKED 👇 1. Crawl4AI GitHub AI-powered web crawling and scraping framework with LLM support. 2. Firecrawl GitHub Turn websites into clean…

        Read full on X, posted by @smratitiwa86867

        @smratitiwa86867 · x.com

    7. May 261 post

      • Best GitHub repos to scrape websites without getting blocked 👇 1. Crawl4AI GitHub AI-powered web crawling and scraping framework. 2. Firecrawl GitHub Turn websites into clean LLM-ready data easily.…

        Read full on X, posted by @smratitiwa86867

        @smratitiwa86867 · x.com

    You might also like

    Repositories close to projectdiscovery/katana
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    hakluke/hakrawler

    Go

    Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application

    5.2k541

    jaeles-project/gospider

    Go

    Gospider - Fast web spider written in Go

    3k334

    Ciyfly/Argo

    Go

    Argo is an automated general crawler for automatically obtaining website URLs . Argo 是一个自动化扫描器爬虫 用于自动化获取网站的URL 基于go-rod实现了静态和动态结合的方式来实现

    21523

    edoardottt/cariddi

    Go

    Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

    3.8k358

    spidersuite/SpiderSuite

    SpiderSuite (web security crawler) releases, wiki and roadmap

    989128

    s0md3v/Photon

    Python

    Incredibly fast crawler designed for OSINT.

    13.3k1.7k

    BRuteLogic/reKover

    Shell

    Stealth hybrid URL mapper

    5713

    zachleat/spider-pig

    JavaScript

    Get a list of local URL links from a root URL.

    685

    duckduckgo/tracker-radar-collector

    JavaScript

    🕸 Modular, multithreaded, puppeteer-based crawler

    17070