Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats
AxiomCode
AxiomCode
Busbar
Busbar
Bifrost
Bifrost

samclarke/robots-parser

NodeJS robots.txt parser with support for wildcard (*) matching.

Visit GitHub
JavaScript
168
19
9 contributors
MIT License
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Busbar

Control what AI can do before it acts

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Momentum

How fast samclarke/robots-parser is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 2 – Oct 19, 2026

Stars +1 in 48 days

01
1

Forks +0 in 48 days

01

Merged PRs 2 in 48 days

01
1

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 2Sep 8Sep 14Sep 20Sep 26Oct 2Oct 8Oct 14
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Wed, Sep 2, 2026+0+00
Thu, Sep 3, 2026+0+00
Fri, Sep 4, 2026+0+00
Sat, Sep 5, 2026+0+00
Sun, Sep 6, 2026+0+00
Mon, Sep 7, 2026+0+00
Tue, Sep 8, 2026+0+01
Wed, Sep 9, 2026+0+00
Thu, Sep 10, 2026+0+00
Fri, Sep 11, 2026+0+00
Sat, Sep 12, 2026+0+00
Sun, Sep 13, 2026+0+00
Mon, Sep 14, 2026+0+00
Tue, Sep 15, 2026+0+00
Wed, Sep 16, 2026+0+00
Thu, Sep 17, 2026+0+00
Fri, Sep 18, 2026+0+00
Sat, Sep 19, 2026+0+00
Sun, Sep 20, 2026+0+00
Mon, Sep 21, 2026+0+00
Tue, Sep 22, 2026+0+00
Wed, Sep 23, 2026+0+00
Thu, Sep 24, 2026+0+00
Fri, Sep 25, 2026+0+00
Sat, Sep 26, 2026+0+00
Sun, Sep 27, 2026+0+00
Mon, Sep 28, 2026+0+00
Tue, Sep 29, 2026+0+00
Wed, Sep 30, 2026+0+00
Thu, Oct 1, 2026+0+00
Fri, Oct 2, 2026+0+00
Sat, Oct 3, 2026+1+00
Sun, Oct 4, 2026+0+00
Mon, Oct 5, 2026+0+00
Tue, Oct 6, 2026+0+00
Wed, Oct 7, 2026+0+00
Thu, Oct 8, 2026+0+01
Fri, Oct 9, 2026+0+00
Sat, Oct 10, 2026+0+00
Sun, Oct 11, 2026+0+00
Mon, Oct 12, 2026+0+00
Tue, Oct 13, 2026+0+00
Wed, Oct 14, 2026+0+00
Thu, Oct 15, 2026+0+00
Fri, Oct 16, 2026+0+00
Sat, Oct 17, 2026+0+00
Sun, Oct 18, 2026+0+00
Mon, Oct 19, 2026+0+00
Total+1+02
  • 1#1 on the list
  • 7Rank that day
  • Not trending

You might also like

Repositories close to samclarke/robots-parser
FeaturedAdvertise to 180K+ monthly visitors
AxiomCode

Give Al Agents a Deeper Understanding of Your Codebase with a Code Graph

Bifrost

Enterprise AI Gateway Built For Scale: Route, Govern, and Secure All Your AI Traffic

Busbar

Control what AI can do before it acts

spatie/robots-txt

PHP

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

25845

monperrus/crawler-user-agents

Go

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome ⭐

1.4k286

omrilotan/isbot

TypeScript

🤖/👨‍🦰 Detect bots/crawlers/spiders using the user agent string

1.2k85

JayBizzle/Crawler-Detect

PHP

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

2.4k278

crawler-commons/crawler-commons

Java

A set of reusable Java components that implement functionality common to any web crawler

25983

ai-robots-txt/ai.robots.txt

Python

A list of AI agents and robots to block.

4.2k198

nuxt-modules/robots

TypeScript

Tame the robots crawling and indexing your Nuxt site.

52854

faisalman/ua-parser-js

JavaScript

UAParser.js: The Essential Web Development Tool for User-Agent Detection. Detect Browsers, OS, Devices, Bots, Apps, AI Crawlers, and more. Run in Browser or Node

10.2k1.2k

jazzband/django-robots

Python

A Django app for managing robots.txt files following the robots exclusion protocol

475101