Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
MCP-with-local-LLM
This project demonstrates running the Phi-3.5-mini-instruct LLM model locally on a Snapdragon Elite X NPU, enhanced with Model Context Protocol (MCP) capabilities.
1stars
0forks
Python
Quality signals
StaleNo testsNo CIThin docsNo licenseNew
InstallMCPRun via uvx (Python)
Universal installANY TOOL
$ npx skillcity@latest Gerr1ck/MCP-with-local-LLMAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Or install manually
uvx mcp-with-local-llm
MCP Configuration
Add this to your claude_desktop_config.json
{
"mcpServers": {
"mcp-with-local-llm": {
"command": "uvx",
"args": [
"mcp-with-local-llm"
]
}
}
}Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
mcp-with-local-llm — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt