Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
web-crawler-mcp-server
A Model Context Protocol (MCP) server for web crawling and news extraction. Enables LLMs to browse the web, extract article content, and process news feeds using newspaper4k and modern web scraping techniques.
1stars
0forks
Python
Quality signals
StaleNo testsNo CIThin docsNo licenseNew
InstallMCPRun via uvx (Python)
Universal installANY TOOL
$ npx skillcity@latest saiminhtet/web-crawler-mcp-serverAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Or install manually
uvx web-crawler-mcp-server
MCP Configuration
Add this to your claude_desktop_config.json
{
"mcpServers": {
"web-crawler-mcp-server": {
"command": "uvx",
"args": [
"web-crawler-mcp-server"
]
}
}
}Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
web-crawler-mcp-server — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt