Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
Bifrost
Bifrost

zachleat/spider-pig

Get a list of local URL links from a root URL.

#Web scraping
Visit GitHub
JavaScript
68
5
4 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast zachleat/spider-pig is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Oct 28 – Nov 4, 2026

Stars +0 in 8 days

01

Forks +0 in 8 days

01

Merged PRs 0 in 8 days

01

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Oct 28Oct 29Oct 30Oct 31Nov 1Nov 2Nov 3Nov 4
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Oct 28, 2026+0+00
Thu, Oct 29, 2026+0+00
Fri, Oct 30, 2026+0+00
Sat, Oct 31, 2026+0+00
Sun, Nov 1, 2026+0+00
Mon, Nov 2, 2026+0+00
Tue, Nov 3, 2026+0+00
Wed, Nov 4, 2026+0+00
Total+0+00
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to zachleat/spider-pig
FeaturedAdvertise to 180K+ monthly visitors
Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

003random/getJS

Go

A tool to fastly get all javascript sources/files

904123

oxylabs/ai-crawler-py

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

3.3k12

lc/subjs

Go

Fetches javascript file from a list of URLS or subdomains.

866112

stevenvachon/broken-link-checker

JavaScript

Find broken links, missing images, etc within your HTML.

2.1k300

JustinBeckwith/linkinator

TypeScript

Broken link checker that crawls websites and validates links. Find broken links, dead links, and invalid URLs in websites, documentation, and local files. Perfect for SEO audits and CI/CD.

1.3k110

PhialsBasement/LibreCrawl

Python

Free desktop SEO crawler - open source alternative to Screaming Frog and similar tools. Crawl websites, analyze links, extract SEO data, and export results without subscription fees. Fully customizable and extensible!

1.1k235

xcrawl-api/xcrawl-skills

Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

44943

yusukebe/ax

TypeScript

The AI-era curl

73416

localnerve/html-snapshots

JavaScript

A selector-based html snapshot tool using Puppeteer or Playwright that sources sitemap.xml, sitemap-index, robots.txt, or arbitrary input

12916