Bring the envs README up to date and register all 22 environments - #197
Merged
Merged
Conversation
The Environments table previewed each environment with a random-action GIF. Each preview is now the solve GIF the RoboDisco site shows, linked to that environment's page there, and the legend says what it shows.
Re-measured every claim in predicators/envs/README.md on October 1: - The Gymnasium registry gains the seven RoboDisco environments it lacked (Balloons, Bridge, BusyBoard, Crane, IceRink, Launcher, Magnets); all 22 build, reset, step and render through the wrapper. - The table lists all 22 with the site's descriptions; Tasks and Skills follow the measured task variation and skill libraries, and the Oracle column (was Demos) names the approach that solves the test task in the default configuration, with the reasons for the rest. - The stale note that Circuit, Cover, Laser and Switch fail to build is replaced by the actual failure: Circuit, Laser and Switch fail when another env was built earlier in the same process. - The Standalone API example wraps its actions in Action, so it runs. - New: task selection and seeding through reset(), the observation layout, the five benchmark domains, and the two skill libraries. The smoke script and the notebook count 22 environments, and the smoke script no longer blames missing CFG for the same-process failures.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Brings
predicators/envs/README.mdup to date, with every claim re-measured on October 1, 2026.Previews.
Each preview is now the solve GIF the RoboDisco site shows, linked to that environment's page, so the README and the site show the same demos.
All 22 environments.
The Gymnasium registry gains the seven RoboDisco environments it lacked (Balloons, Bridge, BusyBoard, Crane, IceRink, Launcher, Magnets).
All 22 build, reset, step and render through the wrapper with the Quick Start configuration.
The table lists all 22 with the site's descriptions and marks the five benchmark domains.
Columns, measured.
get_gt_optionsbuilds a skill library.The old column claimed Boil, Domino, Fan, Float and Grow; today the default configuration solves Ants, Balance, Blocks, Circuit, Cover, Crane, Launcher and Magnets with
oracle, and Grow withoracle_process_planning.Boil and Bridge solve with
oracle_process_planningunder the settings of their oracle tests.The notes say why the rest fail.
The pre-refactor commit
72d7258edgives the same results, so the refactor did not cause any of them.Fixes to stale or broken text.
env.step, which raises; it now wraps it inAction.reset(), the observation layout, the benchmark settings file, and the two skill libraries (CFG.skill_library).The smoke script and the notebook count 22 environments, and the smoke script no longer blames missing CFG for the same-process failures.
The environment bugs found along the way (the same-process failures, and the default-configuration crashes in Domino, Fan, Grow and Coffee) are left for a separate change.
Test plan
makeoverrides, Standalone API).tests/envs/test_robodisco.pypasses with 22 environments.scripts/robodisco_getting_started.pybuilds all 22 environments in one process; only Circuit, Laser and Switch fail, as documented.72d7258ed.🤖 Generated with Claude Code