linkgo
CrawlForge MCP

CrawlForge MCP

AI

MCP server giving AI agents 31 web scraping, search and extraction tools that return clean markdown or structured JSON.

-(0 Reviews)
Free Available
Starting from Free
Premium plans available
Visit Official Site

About CrawlForge MCP

CrawlForge is an MCP server that exposes 31 web tools to AI clients such as Claude, Cursor and LangChain. Agents can fetch pages, scrape them to markdown or typed JSON, map and crawl sites, search the web and run deep multi-source research in a single call. It is installed with one npx config entry and authenticated with an API key, and every tool is metered in credits. The server is open source on npm and GitHub, with a free tier of 1,000 credits.

Screenshots

CrawlForge MCP screenshot 1
+

Key Features

31 MCP-Native Tools: Fetch, scrape, extract, search and research tools exposed through one MCP server that plugs into Claude, Cursor and LangChain.
Clean Markdown and Structured JSON: Converts any URL into AI-ready markdown or schema-defined JSON in a single call.
Site Mapping and Deep Crawling: map_site and crawl_deep discover and follow internal links across entire websites.
Batch Scraping: Process hundreds of URLs in parallel with batch_scrape and retrieve paginated results.
Browser Sessions and Actions: Keep a page alive across calls and scrape pages that need clicks, scrolls or form fills.
Search and Research: search_web, reddit_search and deep research tools return ranked results and multi-source findings.
Change Tracking: track_changes monitors pages with baselines, schedules and alerts.
Credit-Based Metering: Each tool costs 1-5+ credits per call, so usage and cost stay transparent.

Use Cases

Agent Web Access: Giving a coding or research agent live web data through one MCP server.
RAG Ingestion: Converting documentation sites into clean markdown for retrieval pipelines.
Competitor Monitoring: Tracking pricing or content changes on competitor pages with alerts.
SEO Analysis: Checking where a domain ranks for keywords and generating llms.txt files.
Lead and Market Research: Extracting structured data from product, directory and social pages at scale.
Document Processing: Pulling text out of PDFs and other documents found online.

Frequently asked questions about CrawlForge MCP

What is CrawlForge MCP?

MCP server giving AI agents 31 web scraping, search and extraction tools that return clean markdown or structured JSON.

How does CrawlForge MCP work?

CrawlForge MCP works by combining 31 MCP-Native Tools: Fetch, scrape, extract, search and research tools exposed through one MCP server that plugs into Claude, Cursor and LangChain., Clean Markdown and Structured JSON: Converts any URL into AI-ready markdown or schema-defined JSON in a single call., Site Mapping and Deep Crawling: map_site and crawl_deep discover and follow internal links across entire websites., Batch Scraping: Process hundreds of URLs in parallel with batch_scrape and retrieve paginated results., Browser Sessions and Actions: Keep a page alive across calls and scrape pages that need clicks, scrolls or form fills. to help users with Agent Web Access: Giving a coding or research agent live web data through one MCP server., RAG Ingestion: Converting documentation sites into clean markdown for retrieval pipelines., Competitor Monitoring: Tracking pricing or content changes on competitor pages with alerts., SEO Analysis: Checking where a domain ranks for keywords and generating llms.txt files., Lead and Market Research: Extracting structured data from product, directory and social pages at scale..

What are the main features of CrawlForge MCP?

Key features include 31 MCP-Native Tools: Fetch, scrape, extract, search and research tools exposed through one MCP server that plugs into Claude, Cursor and LangChain., Clean Markdown and Structured JSON: Converts any URL into AI-ready markdown or schema-defined JSON in a single call., Site Mapping and Deep Crawling: map_site and crawl_deep discover and follow internal links across entire websites., Batch Scraping: Process hundreds of URLs in parallel with batch_scrape and retrieve paginated results., Browser Sessions and Actions: Keep a page alive across calls and scrape pages that need clicks, scrolls or form fills..

Who is CrawlForge MCP for?

CrawlForge MCP is useful for anyone interested in Agent Web Access: Giving a coding or research agent live web data through one MCP server., RAG Ingestion: Converting documentation sites into clean markdown for retrieval pipelines., Competitor Monitoring: Tracking pricing or content changes on competitor pages with alerts., SEO Analysis: Checking where a domain ranks for keywords and generating llms.txt files., Lead and Market Research: Extracting structured data from product, directory and social pages at scale..

How much does CrawlForge MCP cost?

CrawlForge MCP offers a free tier with paid plans for advanced features.

How do I get started with CrawlForge MCP?

Visit https://www.crawlforge.dev/ to sign up and explore CrawlForge MCP.

Explore more AI Mcps tools

Browse all Mcps tools →

Browse by use case: Automation & Productivity

Compare CrawlForge MCP: vs ai-memory · vs Popcraft · vs Pomerado · vs Manifold MCP