Skip to content

fix(sources): ask Gaia's data server for DATAMODEL_GAIA, which returns the bytes RAW did before Gaia retired it - #1589

Merged
2 commits merged into
mainfrom
fix/gaia-datamodel
Oct 23, 2026
Merged

2 commits merged into
mainfrom
fix/gaia-datamodel

Conversation

@alowpoly

Copy link
Copy Markdown
Contributor

Change

Gaia's data server now refuses DATA_STRUCTURE=RAW with a 500: "The 'RAW' data structure has been deprecated - use 'DATAMODEL_GAIA' instead". Every star's Gaia XP address carried it, so no star whose XP file is missing from the source mirror could be restored or baked.

The parameter is swapped in 5,981 addresses: 829 manifests, their acquisition plans, color records, investigation ledgers and card sources, the src/sources records, and the generator's xpSampledUrl. 705 stars print the address in their baked datasets.json (WASP-103 also in its text), so those files and their inventories change by that string only.

Evidence and limits

Proves the change:

  • The new form returns byte-identical files: β Pictoris's XP sampled and TRAPPIST-1's XP continuous spectra match the copies held (cmp).
  • Acubens's real prepare step writes exactly the swapped datasets.json (cmp), 882 to 893 bytes; the other 704 were swapped and re-pinned the same way.
  • K2-105's restore, which failed with the 500, now fetches both Gaia files and verifies 15 inputs.

Clean: 56 related telescope tests, check-no-hashes, check-color-spelling, check-prepared-delivery.

Prepared assets

  • Published the 706 changed files (publish-runtime-assets.mts --since=origin/main, all verified live).
  • Committed the refreshed inventories, no baked files.

PR rules: titles, PDS4 provenance and ISO plain language.

…/gaia-datamodel

# Conflicts:
#	src/objects/g-9-40/inventory.json
#	src/objects/gj-1156/inventory.json
#	src/objects/gj-33/inventory.json
#	src/objects/hat-p-54/inventory.json
#	src/objects/hd-109833/inventory.json
#	src/objects/hd-110082/inventory.json
#	src/objects/hd-18599/inventory.json
#	src/objects/hd-6569/inventory.json
#	src/objects/hd-80653/inventory.json
#	src/objects/hip-113103/inventory.json
#	src/objects/hip-12545/inventory.json
#	src/objects/hip-94235/inventory.json
#	src/objects/k2-100/inventory.json
#	src/objects/k2-102/inventory.json
#	src/objects/k2-121/inventory.json
#	src/objects/k2-133/inventory.json
#	src/objects/k2-141/inventory.json
#	src/objects/k2-148-b/inventory.json
#	src/objects/k2-148/inventory.json
#	src/objects/k2-154/inventory.json
#	src/objects/k2-179/inventory.json
#	src/objects/k2-182/inventory.json
#	src/objects/k2-190/inventory.json
#	src/objects/k2-198/inventory.json
#	src/objects/k2-212/inventory.json
#	src/objects/k2-216/inventory.json
#	src/objects/k2-265/inventory.json
#	src/objects/k2-284/inventory.json
#	src/objects/k2-29/inventory.json
#	src/objects/k2-369/inventory.json
#	src/objects/k2-370/inventory.json
#	src/objects/k2-65/inventory.json
#	src/objects/k2-77/inventory.json
#	src/objects/k2-83/inventory.json
#	src/objects/k2-88/inventory.json
#	src/objects/kelt-7/inventory.json
#	src/objects/kepler-1313/inventory.json
#	src/objects/kepler-138/inventory.json
#	src/objects/kepler-1656/inventory.json
#	src/objects/kepler-37/inventory.json
#	src/objects/kepler-411/inventory.json
#	src/objects/kepler-538/inventory.json
#	src/objects/kepler-63/inventory.json
#	src/objects/kepler-93/inventory.json
#	src/objects/lhs-1140/inventory.json
#	src/objects/lhs-475/inventory.json
#	src/objects/qatar-2/inventory.json
#	src/objects/toi-1135/inventory.json
#	src/objects/toi-1136/inventory.json
#	src/objects/toi-1224/inventory.json
#	src/objects/toi-2459/inventory.json
#	src/objects/toi-251/inventory.json
#	src/objects/toi-451/inventory.json
#	src/objects/toi-5126/inventory.json
#	src/objects/toi-5398/inventory.json
#	src/objects/toi-6109/inventory.json
#	src/objects/toi-6699/inventory.json
#	src/objects/toi-778/inventory.json
#	src/objects/toi-837/inventory.json
#	src/objects/toi-942/inventory.json
#	src/objects/tyc-1987-509-1/inventory.json
#	src/objects/wasp-107/inventory.json
#	src/objects/wasp-140/inventory.json
#	src/objects/zeta-serpentis/inventory.json
@alowpoly alowpoly closed this pull request by merging all changes into main in 9a53e26 Oct 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant