skillZs
★ LIVE SKILL TAGS ★
>>> LIVE SKILLS INDEX <<<
* OPEN SOURCE *
NO LOGIN, NO TRACKING
※ REAL INSTALL DATA ※
← back to all skills
akillness/jeo-skills96 installs

scientific-llm-benchmarks

A comprehensive reference of benchmarks for evaluating large language models on scientific reasoning and discovery.

How do I install this agent skill?

npx skills add https://github.com/akillness/jeo-skills --skill scientific-llm-benchmarks
view source ↗

Is this agent skill safe to install?

  • Gen Agent Trust Hubpass

    This skill acts as a comprehensive reference for scientific LLM benchmarks. It includes curated lists, data files, and local Python scripts for maintaining documentation and fetching real-world data samples from Hugging Face.

  • Socketpass

    No alerts

  • Snykwarn

    Risk: MEDIUM · 1 issue

What does this agent skill do?

Scientific LLM Benchmarks

This skill provides references to benchmarks used for evaluating large language models on scientific reasoning and discovery. The data comes from the Awesome-Scientific-LLM-Benchmarks repository.

Contents

The complete benchmark list is stored locally within this skill:

  • References List: references/benchmarks.md
  • Data (YAML format): data/benchmarks.yaml

Benchmark Domains Covered

  • General / Multi-domain Science: Cross-disciplinary STEM reasoning benchmarks.
  • Mathematics: Arithmetic, competition, olympiad, and frontier / formal-proof mathematics.
  • Physics and Astronomy: Physics olympiad, graduate physics, computational physics, and astronomy.
  • Chemistry: Molecular property, reaction, retrosynthesis, safety, and chemical knowledge.
  • Materials Science: Crystals, materials property prediction, and materials-science knowledge.
  • Biology and Life Sciences: Genomics, proteins, bioinformatics agents, protocols, and research biology.
  • Agentic Science and AI Research: LLM agents that write research code, run data analyses, attempt autonomous discovery, and conduct ML/AI research.

Helper Scripts

Also included are python scripts inside scripts/:

  • generate_readme.py: Regenerates the markdown tables and list from data/benchmarks.yaml.
  • fetch_examples.py: Fetches real sample rows from HuggingFace dataset URLs specified in the dataset metadata.

Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.

<a href="https://skillzs.dev/skills/akillness/jeo-skills/scientific-llm-benchmarks">View scientific-llm-benchmarks on skillZs</a>