Skip to content

Miles30/fix datagen hang#75

Merged
michaelmckinsey1 merged 2 commits into
LBANN:mainfrom
PatrickRMiles:miles30/fix_datagen_hang
Jun 11, 2026
Merged

Miles30/fix datagen hang#75
michaelmckinsey1 merged 2 commits into
LBANN:mainfrom
PatrickRMiles:miles30/fix_datagen_hang

Conversation

@PatrickRMiles

Copy link
Copy Markdown
Collaborator

Fixes a dataset generation hang in scaffold generate_fractals.

  • Corrects the fractal category acceptance check to measure variance across the point cloud's x/y/z dimensions instead of across coordinates within each point.
  • Rejects non-finite point clouds before normalization and improves category-search progress/accounting output.
  • Updates job scripts to pass an absolute --fract-base-dir, so torchrun-hpc launch directories do not hide the existing fractal category files.


scaffold generate_fractals -c ScaFFold/configs/benchmark_default.yml
CONFIG_PATH="$(pwd)/ScaFFold/configs/benchmark_default.yml"
FRACT_BASE_DIR="${FRACT_BASE_DIR:-$(pwd)/ScaFFold/fractals}"

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So we are always overriding whatever fract_base_dir is in the config?

@michaelmckinsey1 michaelmckinsey1 merged commit 5ef0c5a into LBANN:main Jun 11, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants