Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
MIRA-Multimodal-Intelligent-Robotic-Assistant
基于Qwen Agent框架，融合JAKA机械臂、视觉检测、语音识别与合成、MCP数据库的多模态大模型
19stars
5forks
Python
edge-ttsfunction-callingllmmcpmutimodalorangepiqwenqwen-agentqwen-vl-maxvlmyolo
Quality signals
StaleNo testsNo CIThin docsNo licenseNew
AI summary
Auto-generated overview of what this skill does and when to reach for it.
A multimodal AI assistant that controls a robotic arm using voice, text, or images via Qwen Agent and external hardware like cameras and micro:bit.
Use this when
- Need a robot arm to pick up objects based on voice/text/image commands
- Want to integrate vision, speech, and database queries into one assistant
- Building a demo for multimodal LLM tool-calling with real hardware
- Testing coordinate calibration between camera and robotic arm
- Prototyping human-robot interaction with speech feedback
Don't use when
- No robotic arm hardware available
- Only need text-based chat without external tools
- Working in a headless environment without GUI
Capabilities
- Controls JAKA robotic arm via serial/TCP commands
- Processes voice input with Baidu speech recognition API
- Generates speech responses using Edge TTS
- Runs Qwen LLM for tool-calling and context memory
- Uses QwenVL for image understanding and object detection
- Streams real-time camera feed for visual feedback
InstallMCPInstall as a Claude Code skill
Universal installANY TOOL
$ npx skillcity@latest johnnyhank/MIRA-Multimodal-Intelligent-Robotic-AssistantAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor or Cline.
Requires Node.js 18+ (ships with npx).
Or install manually
# Install into ~/.claude/skills/ mkdir -p ~/.claude/skills/mira-multimodal-intelligent-robotic-assistant curl -fsSL https://raw.githubusercontent.com/johnnyhank/MIRA-Multimodal-Intelligent-Robotic-Assistant/main/README.md -o ~/.claude/skills/mira-multimodal-intelligent-robotic-assistant/SKILL.md
Readme
Loading README…