Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Busbar
Busbar
Bifrost
Bifrost
AxiomCode
AxiomCode

byungjunjang/web-crawler

범용 웹 크롤링 에이전트 — URL과 수집 항목으로 사이트를 정찰·대량수집·엑셀 출력

#AI agent#Web scraping
Visit GitHub
Python
177
93
2 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Momentum

How fast byungjunjang/web-crawler is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Aug 20 – Oct 19, 2026

Stars +24 in 61 days

0123
3

Forks +93 in 61 days

01020
20

Merged PRs 0 in 61 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Aug 20Aug 28Sep 5Sep 13Sep 21Sep 29Oct 7Oct 15
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Thu, Aug 20, 2026+0+10
Fri, Aug 21, 2026+0+00
Sat, Aug 22, 2026+0+00
Sun, Aug 23, 2026+0+00
Mon, Aug 24, 2026+0+00
Tue, Aug 25, 2026+0+00
Wed, Aug 26, 2026+0+00
Thu, Aug 27, 2026+0+00
Fri, Aug 28, 2026+0+00
Sat, Aug 29, 2026+0+00
Sun, Aug 30, 2026+0+00
Mon, Aug 31, 2026+0+200
Tue, Sep 1, 2026+0+160
Wed, Sep 2, 2026+0+90
Thu, Sep 3, 2026+0+40
Fri, Sep 4, 2026+0+20
Sat, Sep 5, 2026+0+20
Sun, Sep 6, 2026+0+20
Mon, Sep 7, 2026+0+10
Tue, Sep 8, 2026+0+40
Wed, Sep 9, 2026+0+20
Thu, Sep 10, 2026+0+20
Fri, Sep 11, 2026+0+10
Sat, Sep 12, 2026+0+20
Sun, Sep 13, 2026+0+10
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+10
Wed, Sep 16, 2026+0+30
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+10
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+10
Wed, Sep 23, 2026+0+10
Thu, Sep 24, 2026+0+10
Fri, Sep 25, 2026+0+10
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+20
Mon, Sep 28, 2026+0+10
Tue, Sep 29, 2026+0+10
Wed, Sep 30, 2026+0+10
Thu, Oct 1, 2026+2+00
Fri, Oct 2, 2026+0+10
Sat, Oct 3, 2026+2+20
Sun, Oct 4, 2026+1+10
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+2+10
Wed, Oct 7, 2026+2+20
Thu, Oct 8, 2026+3+10
Fri, Oct 9, 2026+2+00
Sat, Oct 10, 2026+1+00
Sun, Oct 11, 2026+1+10
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+1+00
Wed, Oct 14, 2026+1+00
Thu, Oct 15, 2026+0+10
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+1+00
Sun, Oct 18, 2026+3+00
Mon, Oct 19, 2026+2+00
Total+24+930
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to byungjunjang/web-crawler
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

ScrapeGraphAI/scrapecraft

Python

🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

720117

itsOwen/CyberScraper-2077

Python

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

3.3k384

xcrawl-api/xcrawl-skills

Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

44943

Cedriccmh/claude-code-skill-scrapling

Python

Claude Code skill for web scraping with scrapling - auto Fetcher selection, Cloudflare bypass, site patterns

45463

tinyfish-io/agentql-mcp

TypeScript

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

18146

badlogic/sitegeist

TypeScript

An AI assistant that lives in your browser. Built for collaboration, not autonomy theater. You guide, it executes. Automate repetitive web tasks, extract data from any website, and transform it into whatever you need.

905149

jaypyles/Scraperr

TypeScript

Self-hosted webscraper.

4.9k260

getmaxun/maxun

TypeScript

Turn any website into a structured API. Extract, automate, search and monitor the web.

17.9k1.6k

oxylabs/ai-crawler-py

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

3.3k12