Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
sitecrawl
Production-ready Go CLI + agent skill for domain-scoped crawling with Chrome (chromedp), clean content extraction, PageRank-based prioritization, and structured md/html/json outputs with metadata-rich reports.
1stars
0forks
Go
agentchromedpcodexgogolangopenclawpagerankscrapingskillweb-crawlerwebsite-crawler
Quality signals
ActiveNo testsNo CIThin docsNo licenseNew
InstallSKILLInstall as a Claude Code skill
Universal installANY TOOL
$ npx skillcity@latest SbstnErhrdt/sitecrawlAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Or install manually
# Install into ~/.claude/skills/ mkdir -p ~/.claude/skills/sitecrawl curl -fsSL https://raw.githubusercontent.com/SbstnErhrdt/sitecrawl/main/SKILL.md -o ~/.claude/skills/sitecrawl/SKILL.md
Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
sitecrawl — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt