Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
teracrawl
High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative
264stars
29forks
TypeScript
ai-agentsai-crawlerai-scrapingai-searchantibot-bypassbrowser-agentbrowser-automationcrawl4aidata-extractionfirecrawl-alternativefirecrawl-apifirecrawl-mcp
Quality signals
StaleNo testsNo CIThin docsNo licensePopular
AI summary
Auto-generated overview of what this skill does and when to reach for it.
A fast web crawler that turns websites into clean Markdown for LLM training or data extraction.
Use this when
- Need to scrape a single website into Markdown
- Want to extract clean text from dynamic pages with JavaScript
- Building a dataset from search results or forums
- Converting documentation sites to readable text
- Extracting product details from e-commerce pages
Don't use when
- Crawling a site that blocks bots aggressively
- Need real-time data without delays
- Extracting sensitive or private content
Capabilities
- Renders JavaScript-heavy pages
- Outputs clean Markdown without boilerplate
- Handles pagination automatically
- Supports custom selectors for targeted extraction
- Runs headless browsers remotely
- Scales with multiple concurrent requests
Install
Universal installANY TOOL
$ npx skillcity@latest BrowserCash/teracrawlAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Prefer to set it up by hand? Clone the repository:
git clone https://github.com/BrowserCash/teracrawl.git
Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
teracrawl — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt