Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
Web-knowledge-Crawler
A distributed Model Context Protocol (MCP) server implementing an intelligent web ingestion and retrieval-augmented generation pipeline for AI agents and coding assistants.
8stars
5forks
Python
Quality signals
StaleNo testsNo CIThin docsNo licenseNew
InstallMCPRun via uvx (Python)
Universal installANY TOOL
$ npx skillcity@latest Anshumaan031/Web-knowledge-CrawlerAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Or install manually
uvx web-knowledge-crawler
MCP Configuration
Add this to your claude_desktop_config.json
{
"mcpServers": {
"web-knowledge-crawler": {
"command": "uvx",
"args": [
"web-knowledge-crawler"
]
}
}
}Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
web-knowledge-crawler — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt