Skip to content

Add local H5 worker sessions#952

Merged
anth-volk merged 17 commits into
mainfrom
codex/h5-migration-pr5-worker-session
May 12, 2026
Merged

Add local H5 worker sessions#952
anth-volk merged 17 commits into
mainfrom
codex/h5-migration-pr5-worker-session

Conversation

@anth-volk
Copy link
Copy Markdown
Collaborator

@anth-volk anth-volk commented May 11, 2026

Fixes #951

Summary

  • Adds local-area H5 worker session setup for source data, weights, geography, validation context, and bootstrap artifacts.
  • Passes run-scoped config, artifact paths, and explicit worker scope into local-area H5 workers.
  • Consumes valid worker bootstrap artifacts when available, falls back to raw loaders during the dual-path migration, and surfaces worker subprocess stderr on successful runs so bootstrap status is visible in Modal logs.

Verification

  • ruff check modal_app/local_area.py tests/unit/test_modal_local_area.py
  • uv run --no-sync pytest tests/unit/test_modal_local_area.py -q
  • uv run --no-sync --with pyyaml python scripts/run_quality_guards.py

@anth-volk anth-volk force-pushed the codex/h5-migration-pr5-worker-session branch 2 times, most recently from 305bb74 to 6f97558 Compare May 12, 2026 11:47
@anth-volk anth-volk changed the title Add local H5 worker sessions and stale fingerprint guards Add local H5 worker sessions May 12, 2026
@anth-volk anth-volk force-pushed the codex/h5-migration-pr5-worker-session branch from d9f1ed7 to b81d36c Compare May 12, 2026 12:21
@anth-volk anth-volk force-pushed the codex/h5-migration-pr5-worker-session branch from bba7777 to 57a4388 Compare May 12, 2026 18:03
@anth-volk anth-volk marked this pull request as ready for review May 12, 2026 18:26
@anth-volk anth-volk merged commit e14a26f into main May 12, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add local H5 worker sessions

1 participant