Discover the toolingbehind modern intelligence
The operating system for AI infrastructure discovery. Search a live map of MCP servers, AI agents, LLM tools, automation systems, and developer infrastructure.
agent-eval-harness
Evaluate AI agents with Unix-style pipeline commands. Schema-driven adapters for any CLI agent, trajectory capture, pass@k metrics, and multi-run comparison.
3stars
1forks
TypeScript
agent-comparisonagent-evaluationai-agentsbunclieval-harnessgraderheadless-adapterjsonlllm-evaluationpass-at-ktrajectory-capture
Quality signals
ActiveNo testsNo CIThin docsNo licenseNew
InstallSKILLInstall as a Claude Code skill
Universal installANY TOOL
$ npx skillcity@latest plaited/agent-eval-harnessAuto-detects the skill or MCP server in this repo and installs it for Claude Code, Codex, Cursor, Cline, OpenCode, Gemini CLI, Anti-Gravity, OpenClaw and Hermes.
Requires Node.js 18+ (ships with npx).
Or install manually
# Install into ~/.claude/skills/ mkdir -p ~/.claude/skills/agent-eval-harness curl -fsSL https://raw.githubusercontent.com/plaited/agent-eval-harness/main/SKILL.md -o ~/.claude/skills/agent-eval-harness/SKILL.md
Loading README…
Ask a simulated agent to run this skill. It loads the real SKILL.md and reasons over your task with NVIDIA.
agent-eval-harness — sandboxAI sandbox
Pick a quick prompt below or type your own — watch the agent execute this skill step by step.
guest@skillcity:~$Try a prompt