Skip to content

Repository files navigation

AREX-Skill turns repository and paper knowledge into executable skills for coding agents and autonomous ML research

AREX-Skill
✨ Advancing Auto-Research with Skills Distilled from GitHub Repos 🚀

AREX-Skill Library: 5000+ skills 1000 ML repositories DisCo CLI v0.2.0 License: Apache 2.0 Documentation Contributing guide

English · 简体中文

🧠 5,000+ verified, executable skills distilled from 1,000+ popular repositories
Seamless integration with Codex, Claude Code, Pi, and other coding agents
🔬 Advancing frontier auto-research across across multidisciplinary machine learning studies

🎬 Demo

A one-minute tour of AREX-Skill: DisCo distills a repository into verified, executable skills, the router narrows 5,000+ skills to the one branch a task needs, and a skill-equipped agent clears a task that stalls without it.

disco_web.mp4

🧭 Table of Contents

📣 News

  • 2026-08-27: The library reached 1,000 repositories and 5,000+ skills, with a rebuilt router covering the published repository collection.
  • 2026-08-03: AREX-Skill launched with DisCo's Creator and Researcher workflows and the first library release covering more than 170 widely used repositories.

💡 Why AREX-Skill

Research knowledge is abundant, but most of it is still written for humans. Papers explain methods and why they work. Repositories contain working implementations. Blogs and examples record practical tricks and failure modes. An agent still has to search through those sources, decide what applies, piece together a workflow, debug missing steps, and determine whether the result is credible.

AREX-Skill turns that missing operating knowledge into an interface an agent can use. Instead of summarizing a repository, an AREX Skill captures when a capability applies, what to run, how to validate it, and how to recover when an experiment fails.

An AREX Skill is a self-contained, agent-readable unit of operating knowledge. It uses the open Agent Skills format as its portable packaging convention, then adds the operating context an agent needs: when to use a capability, what to run, how to validate it, and how to recover when an experiment fails. Each skill is organized around SKILL.md, with optional references/ and scripts/ resources:

skill/
├── SKILL.md       # scope, routing, workflow, and validation
├── references/    # focused instructions and source provenance
└── scripts/       # executable helpers, diagnostics, and checks

When a repository exposes multiple capabilities, its skills are composed into a repository skill graph. A router first narrows a request to an area, family, repository, and workflow; the agent then loads only the branch it needs. This progressive-disclosure design keeps the initial context focused while preserving access to deeper instructions and helpers. See the library guide and architecture guide for the runtime model and routing details.

How skills enter an autonomous research task

A research agent typically follows this pattern:

  1. Start with a concrete research goal.
  2. Route the request to the relevant skill graph.
  3. Load only the needed SKILL.md branch and follow linked skills as needed.
  4. Run the recommended procedures and scripts, using the skill's checks and recovery guidance during execution.
  5. Validate the result against the relevant checks and target metric. If the run fails, follow the recovery guidance, iterate, and validate again.

The result is not just an answer: it is an experiment or implementation that can be inspected and reproduced.

📊 Library at a Glance

AREX-Skill Library coverage across 20 research areas and 178 package families

20 research areas · 178 package families · 1,000 repositories · 5,000+ verified skills

The AREX-Skill Library covers ML engineering, LLMs, computer vision, data science, scientific computing, model deployment, training infrastructure, robotics, generative media, biomedical AI, and related fields. Browse the repository catalog to explore the complete area and package-family inventory, or inspect the imported skills catalog for upstream repositories and source baselines.

The library's repository-skill router narrows a request before the agent loads the matching graph branch. Repository skills are maintained against upstream changes; source commits, validation steps, and refresh requirements are documented in Refreshing Repo Skills.

📈 Auto-Research Benchmark Results

We keep the agent setup, harness, and execution budget fixed, and change only whether the agent has AREX-distilled skills.

Benchmark results comparing Codex with and without AREX-Skill across MLE-bench, PaperBench, FrontierCS, and PassNet

Codex with AREX-Skill improves results across four autonomous research benchmarks.

Benchmark Scenario Metric Codex Codex + AREX-Skill Gain
MLE-bench ML engineering (75 Kaggle competitions) Any Medal rate (%) 31.11 72.89 +134.3%
PaperBench Paper replication (20 papers) Replication score 29.45 39.59 +34.4%
FrontierCS Algorithm optimization (188 Agent Track tasks) Score 70.63 77.14 +9.2%
PassNet Compiler pass optimization (200 samples) AS Score 1.343 1.531 +14.0%

Three takeaways:

  • Operating knowledge matters. AREX-Skill adds reusable procedures, checks, and recovery paths without changing the underlying agent workflow.
  • The advantage is strongest on difficult tasks. Skills help the agent avoid expensive unguided trial-and-error and recover from near-failure states.
  • The budget is spent more productively. A relevant skill graph helps the agent reach a useful region of the solution space earlier and spend more of its budget on experiments and validation.

The complete technical report is forthcoming. Until it is published, the table above is the concise summary of the current evaluation results.

⚗️ How AREX-Skill Is Built

The library is produced by DisCo Creator through a four-stage skill-distillation workflow: scope capabilities from an anchor, ground them in admissible evidence, construct a candidate skill graph, and verify and refine it before publication. The anchor can be a source for task-agnostic distillation or a problem for task-oriented distillation. Supporting evidence, validation checks, and unresolved gaps are retained in the construction record.

The four-stage skill-distillation process: scope capability, ground evidence, construct a skill graph, and verify and refine

See DisCo Workflows for the construction lifecycle, and DisCo Meta Skills for the bundled Creator workflows and portable installation guidance.

🚀 Quick Start

1. Install DisCo

DisCo requires Node.js >=22.19.0:

npm install -g @auto-ml-skills/disco

Configure a model provider on first run with /login, or use an environment variable such as OPENAI_API_KEY, ANTHROPIC_API_KEY, or GEMINI_API_KEY. See the Installation Guide for provider setup and source builds.

2. Install the library and start Researcher mode

disco repo-skills install
disco

DisCo's default Researcher mode natively loads and routes the AREX-Skill Library. At the prompt, try a concrete task:

Use the installed skills to benchmark vLLM and SGLang on this machine under the same model, workload, and hardware constraints. Report verified throughput and preserve the commands and measurements needed to reproduce the comparison.

The router selects relevant repository skills and the agent progressively loads only the instructions needed for the task.

3. Import selected skills into another coding agent

DisCo can export selected repository skills and a scoped router to compatible coding agents. For Codex's recommended user-level skills directory:

disco --creator -p "/skill:import-repo-skills-to-agent import vllm and sglang to ~/.agents"

For Claude Code, use its user-level skills directory instead:

disco --creator -p "/skill:import-repo-skills-to-agent import vllm and sglang to ~/.claude"

Restart the target agent after import so it reloads the new skills. For target layouts, overwrite handling, portable Creator workflows, and other agents, see DisCo Meta Skills and DisCo Workflows.

Create or refresh skills

DisCo Creator can also construct repository and paper skills, verify them, and refresh existing repository skills against new upstream evidence. Those workflows are intentionally kept out of the minimal Quick Start:

🖼️ Usage Examples

The library can be used for many ML workflows. Here are two representative scenarios from the repository-skill collection.

High-throughput inference

vLLM and SGLang skills can guide a controlled serving comparison:

Compare vLLM and SGLang on this model and workload. Tune both under identical
hardware and memory constraints, report verified throughput, and preserve the
commands and measurements needed to reproduce the comparison.

Protein structure modeling

AlphaFold2 skills provide operational guidance for a protein-structure modeling workflow:

Use the installed AlphaFold2 skills to set up and verify this protein-structure
modeling workflow. Start with a tiny synthetic input, check the sequence/MSA
shapes and dependencies, run the relevant model path, and report the commands
and checks needed to reproduce the result. Do not treat untrained outputs as
scientific predictions.

For complete end-to-end session exports, see the examples directory.

More repository capabilities are available through FAISS, Unsloth, Diffusers, LeRobot, AlphaFold2, and the full repository catalog.

📚 Documentation

Guide Use it to…
Installation Guide Install DisCo, configure providers, install or update the library, or build from source.
DisCo Workflows Run Researcher and Creator workflows, verify graphs, and export skills.
DisCo Meta Skills Create repository or paper skills and install portable Creator workflows.
Refreshing Repo Skills Refresh a skill against upstream changes and update provenance, routing, and catalog data.
AREX-Skill Library Understand the runtime collection, router, repository graphs, and managed installation.
Repository Catalog Browse the complete area and package-family inventory.
Documentation Index Find every documentation page and choose what to read next.

🤝 Contributing

Contributions are welcome in three areas:

  1. Add repository skills. Submit a verified graph under skills/repositories/repo-skills//, then update its router and public catalog when routing or coverage changes.
  2. Refresh or extend existing skills. Use current upstream evidence, preserve provenance and license metadata, and include the verification steps that support the change.
  3. Improve DisCo and its workflows. Contribute CLI, runtime, bundled skill, and documentation changes under cli/ and the surrounding project docs.

Skill pull requests should identify the upstream source commit, model and provider, reasoning level where relevant, production workflow, verification commands, known gaps, and any router or catalog updates. See the Contribution Guide for the full checklist and CONTRIBUTING_CN.md for the Chinese version.

🙏 Acknowledgement

DisCo's CLI and agent runtime are built on the foundation of earendil-works/pi, an open-source AI agent toolkit with a unified LLM API, agent loop, terminal UI, and coding-agent CLI.

AREX-Skill is also made possible by the GitHub open-source community. The repo skills in this library exist because many researchers and engineers have released high-quality ML, agent, data, bio/chem, vision, and infrastructure projects for the community to build on.

📄 License

Unless a file or component states otherwise, repository-level AREX-Skill materials are released under the Apache License 2.0.

⚠️ Every skill in the AREX-Skill Library has its own license. Before using, copying, modifying, or redistributing a skill, check the license metadata field in that skill's SKILL.md. That per-skill license is authoritative for the skill; it is not replaced by this repository's Apache-2.0 license.

The standalone DisCo npm package under cli/ is distributed under its own MIT License, with upstream attribution in cli/THIRD_PARTY_NOTICES.md.

📝 Citation

TBA

About

A Skill Library for Automated Machine Learning

Resources

Contributing

Stars

12 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages