Skip to content

fix: evaluate the run main.py trained, not a fixed folder - #4

Merged
NaNIsaac merged 1 commit into
mainfrom
fix/evaluate-reads-own-run
Oct 23, 2026
Merged

NaNIsaac merged 1 commit into
mainfrom
fix/evaluate-reads-own-run

Conversation

@NaNIsaac

Copy link
Copy Markdown
Owner

The __main__ blocks of evaluate.py and evaluate_with_real_data.py in exp02 and exp04 now take the run folder from CONFIG["base_dir"] / CONFIG["exp_name"], the folder main.py trains into. Before, both read $DATA/XRR_AI/data/one_layer/run, so exp04 evaluated exp02's location.

This changes which dataset and checkpoint a standalone evaluation reads. The real-measurement folder (one_layer/real_tester) is unchanged; it is shared input. Not run: there is no data or GPU here; ruff passes and the files compile.

exp04's config.py still has a local Windows base_dir, as the README says for all experiments.

Fixes #3

@NaNIsaac
NaNIsaac merged commit c0a9c5b into main Oct 23, 2026
1 check passed
@NaNIsaac
NaNIsaac deleted the fix/evaluate-reads-own-run branch October 23, 2026 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

exp02/exp04 evaluate scripts read a fixed folder, not the run main.py trained

1 participant