us/crwMCPMCP Server

crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

135stars

12forks

Rust

aiai-agentscrawlerdata-extractiondockerfirecrawlfirecrawl-alternativehtml-to-markdownllmmarkdownmcpmcp-server

Quality signals

ActiveNo testsNo CIThin docsNo licensePopular

Open Repository Download ZIP

AI summary

Auto-generated overview of what this skill does and when to reach for it.

Lightning-fast Rust web scraper and crawler with Firecrawl-compatible API for AI agents, self-hostable in a single binary.

Use this when

Need to scrape live web pages for RAG pipelines
Building AI tools that read or search the web
Converting HTML to clean markdown for LLMs
Running a local web crawler without Docker or Redis
Replacing Firecrawl with a faster, lighter alternative

Don't use when

Scraping JavaScript-heavy sites behind strict anti-bot walls
Need enterprise-grade support or SLA guarantees
Working with non-English content without translation tools

Capabilities

Single binary under 6MB RAM usage
Firecrawl-compatible /v1/scrape, /v1/crawl, /v1/search endpoints
Auto-detects SPAs and renders via LightPanda or Chrome
Async BFS crawler with rate limiting
LLM extraction with JSON schema validation
Built-in MCP server for AI agents (stdio/HTTP)

InstallMCPRun inside a container

Universal installANY TOOL

$ npx skillcity@latest us/crw

Auto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.

Requires Node.js 18+ (ships with npx).

Or install manually

docker run -i --rm crw

MCP Configuration

Add this to your claude_desktop_config.json

{
  "mcpServers": {
    "crw": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "crw"
      ]
    }
  }
}

Loading README…

Discover the toolingbehind modern intelligence

Discover the toolingbehind modern intelligence

crw