reproducibility-audit
Audit whether a result can actually be reproduced from the available code, data, configs, and documentation. Use before trusting a benchmark claim or releasing your own work. Use for replication, code release checks, paper artifact sanity checks, lab handoffs, catching missing seeds/configs/data before results are cited, or whenever "works on my machine" is a risk. If the user wants to plan what to include in a public artifact package, use artifact-release-packager instead; this skill's job is to test whether reproduction is possible and where it breaks.
How do I install this agent skill?
npx skills add https://github.com/jurgendn/agent-skills --skill reproducibility-auditIs this agent skill safe to install?
- Gen Agent Trust Hubpass
The skill provides a structured workflow for auditing the reproducibility of research results and codebases. No malicious patterns or security risks were detected in the skill's instructions or configuration.
- Socketpass
No alerts
- Snykpass
Risk: LOW · No issues
What does this agent skill do?
Reproducibility Audit
Assume the result is not reproducible until the missing pieces are enumerated.
Workflow
-
Identify the target result to reproduce.
-
Check for the required ingredients:
- code
- commit/version pinning
- data access
- config files
- preprocessing steps
- hardware assumptions
- seed handling
references/good-enough-baseline.mdexpands this into a concrete presence/absence checklist (data provenance, pinned dependencies, smoke test, version identity, determinism) grounded in Good Enough Practices in Scientific Computing (Wilson et al., 2017) — a missing item there is a finding, not a minor annoyance. -
Attempt to map paper claims to executable steps.
-
Record ambiguities and blockers explicitly.
-
If running code, log exact commands and outputs.
-
Classify status:
- reproduced
- partially reproduced
- blocked
- inconsistent with paper
-
Recommend the smallest fixes needed for reproducibility.
Rules
- Do not say reproduced unless you ran and checked it.
- Missing config details are findings, not minor annoyances.
- Separate code availability from result reproducibility.
Output shape
Return:
- Target result
- Available artifacts
- Missing artifacts
- Reproduction status
- Commands / evidence
- Recommended fixes
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/jurgendn/agent-skills/reproducibility-audit">View reproducibility-audit on skillZs</a>