Web scraping

High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG. Adaptive crawling, clean Markdown, structured data, PDF/RSS parsing, browser rendering, Firecrawl-compatible APIs, and Python/Node.js SDKs.

Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP.

MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl.

Reddrix is an open-source, blazing-fast Reddit Scraper for Python (No Login or API Key)

Scrape Facebook GraphQL data without an API key — profiles, posts, comments, reactions, groups, marketplace, search_engine.

A web-reading tool for LLM agents that returns the parts of a page relevant to a question, verbatim

Self-hosted Google search scraper for Python. Scrape Google SERP results with a real Chrome browser and your own residential proxy. Self-hosted SERP API alternative with JSON output, an HTTP API and an MCP server for AI agents.

Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.

Makra is a memory layer between the web and your AI agents. It serves real-time structured data from the open web at the cost of a vector search.

Flight and hotel search for the terminal, Python, and AI assistants.

Lightweight self-hosted web search & extract service for Hermes Agent, a drop-in Firecrawl alternative

Self-hosted Google Maps multi-category scraper with configurable fields and website, email, and phone enrichment.

Free, open-source YouTube scraper library for Python. Search YouTube and extract video, channel, and playlist data without an API key or quota limits.

Finance API tool to extract S&P 500 company tickers, financial data, and ESG scores

Google Play scraper for Node.js with a fully typed TypeScript API. App details, search, top charts, reviews, permissions and data safety. A modern replacement for the unmaintained google-play-scraper.

The AI-era curl

Janitor Ai Ripper - a local toolkit for scraping content hosted on JAI

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

Free Google Maps scraper for lead generation. Exports phones, emails, websites and socials to CSV. Runs locally in Docker, no API keys. Claude Code skill included.

An interactive CLI research assistant that scrapes, sanitizes, and synthesizes web content locally or via Gemini/OpenAI/Claude, with Discord/Telegram alerts & built-in automation.