capture-eval-issues
Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.
How do I install this agent skill?
npx skills add https://github.com/codagent-ai/agent-validator --skill capture-eval-issuesIs this agent skill safe to install?
- Gen Agent Trust Hubfail
The skill is vulnerable to command injection because it instructs a subagent to dynamically build shell commands using data from external review logs. A malicious log file could execute arbitrary code by breaking out of the command's string literals.
- Socketpass
No alerts
- Snykpass
Risk: LOW · No issues
What does this agent skill do?
/capture-eval-issues
Capture noteworthy review violations into the eval inventory.
Input
This skill receives one or more review JSON file paths as arguments (space-separated).
Example: /capture-eval-issues validator_logs/review_src_claude@1.0.json validator_logs/review_src_gemini@2.0.json
Procedure
- Read
judge-prompt.mdfrom this skill's directory - Spawn a subagent to judge and capture violations:
- Task tool:
Taskwithsubagent_type="general-purpose",model="sonnet",prompt=judge-prompt content +"\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>" - The subagent handles everything: reading files, judging, calling the append script
- Task tool:
- Report the subagent's capture summary (the
CAPTURED:line)
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/codagent-ai/agent-validator/capture-eval-issues">View capture-eval-issues on skillZs</a>