Web Scraping & Data Listings
Compare the best open-source listings for web scraping & data. Crawl, scrape and extract structured data. Ranked by GitHub stars, with install commands, what each one can touch and scan reports where available.
Scrapecraft
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Mantic Sh
A structural code search engine for Al agents.
Kindly Web Search MCP Server
Kindly Web Search MCP Server: Web search + robust content retrieval for AI coding tools (Claude Code, Codex, Cursor, GitHub Copilot, Gemini, etc.) and AI agents (Claude Desktop, OpenClaw, Hermes, etc.). Supports Serper, Tavily, and SearXNG.
Graphlit MCP Server
Model Context Protocol (MCP) Server for Graphlit Platform
MCP Omnisearch
🔍 A Model Context Protocol (MCP) server providing unified access to multiple search engines (Tavily, Brave, Kagi, Exa), AI tools (Kagi FastGPT, Exa, Linkup), and content extraction services (Firecrawl, Tavily, Kagi). Includes GitHub search. All through a single interface.
SpotifyScraper
Extract public Spotify data — tracks, albums, artists, playlists, podcasts & lyrics — without the official API. Sync + async, typed models, one dependency.
LLM Reader
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.
Teracrawl
High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative
Alfanous
Alfanous is an Arabic search engine API provides the simple and advanced search in Quran , more features and many interfaces...
PyScrappy
Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.
OpenPlexity Pages
SearchGPT / Perplexity Pages clone, but personalised for you.
Firecrawl Claude Plugin
Firecrawl plugin for Claude Code: search the live web, developer docs, government sources and research papers, run structured data providers, and scrape a page into clean Markdown. Firecrawl is the context API for AI agents.
Vexor
A semantic search engine for files and code.
Amazon Scraper V2
Agent-ready Amazon Scraper API: real-time product details (batch ASIN), offers & stock, reviews, search, best sellers, deals and seller data across 20 marketplaces. One pasted line for Claude Code / Codex / Cursor, an MCP server, or plain HTTP with 3 free calls a day and no key. Python examples inside.
Argo
专门为 agent 打造的开源 agent 搜索工具，具备 200+的搜索源及多语言搜索能力，覆盖中文/英文/学术/代码/购物/金融/新闻/百科。
Open Extract
Structured Data Extractor for AI Agents. Search your documents or the web for specific data and get it back in JSON or Markdown in a single tool call.
SearxNcrawl
Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.
Serpapi MCP
SerpApi MCP Server for Google and other search engine results
Pagesift
Rust web scraper & crawler for AI agents: URLs, PDFs and Office files → clean Markdown/JSON. Firecrawl- and Jina Reader-compatible API, MCP server, Python/Node SDKs. Self-hosted single binary.
Agentql MCP
Model Context Protocol server that integrates AgentQL's data extraction capabilities.
BrowserPilot
Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined
Scrapeless MCP Server
Scrapeless Mcp Server
MCP Read Website Fast
Quickly reads webpages and converts to markdown for fast, token efficient web scraping
Crawl4ai MCP Server
用于提供给本地开发者的 LLM的高效互联网搜索&内容获取的MCP Server， 节省你的token
List refreshed November 15, 2026. Data comes from public GitHub repositories.