scientific-llm-benchmarks
A comprehensive reference of benchmarks for evaluating large language models on scientific reasoning and discovery.
How do I install this agent skill?
npx skills add https://github.com/akillness/jeo-skills --skill scientific-llm-benchmarksIs this agent skill safe to install?
- Gen Agent Trust Hubpass
This skill acts as a comprehensive reference for scientific LLM benchmarks. It includes curated lists, data files, and local Python scripts for maintaining documentation and fetching real-world data samples from Hugging Face.
- Socketpass
No alerts
- Snykwarn
Risk: MEDIUM · 1 issue
What does this agent skill do?
Scientific LLM Benchmarks
This skill provides references to benchmarks used for evaluating large language models on scientific reasoning and discovery. The data comes from the Awesome-Scientific-LLM-Benchmarks repository.
Contents
The complete benchmark list is stored locally within this skill:
- References List:
references/benchmarks.md - Data (YAML format):
data/benchmarks.yaml
Benchmark Domains Covered
- General / Multi-domain Science: Cross-disciplinary STEM reasoning benchmarks.
- Mathematics: Arithmetic, competition, olympiad, and frontier / formal-proof mathematics.
- Physics and Astronomy: Physics olympiad, graduate physics, computational physics, and astronomy.
- Chemistry: Molecular property, reaction, retrosynthesis, safety, and chemical knowledge.
- Materials Science: Crystals, materials property prediction, and materials-science knowledge.
- Biology and Life Sciences: Genomics, proteins, bioinformatics agents, protocols, and research biology.
- Agentic Science and AI Research: LLM agents that write research code, run data analyses, attempt autonomous discovery, and conduct ML/AI research.
Helper Scripts
Also included are python scripts inside scripts/:
generate_readme.py: Regenerates the markdown tables and list fromdata/benchmarks.yaml.fetch_examples.py: Fetches real sample rows from HuggingFace dataset URLs specified in the dataset metadata.
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/akillness/jeo-skills/scientific-llm-benchmarks">View scientific-llm-benchmarks on skillZs</a>