fix(scraper): visible scrape diagnostics + dispatchable GH scraper path - #62

Merged

KSaifStack merged 13 commits into

mainfrom

fix/scraper-survey

Sep 29, 2026

Commits on Sep 29, 2026

ci(scrape): observable GH-runner scrape with dispatch + hourly schedule
KSaifStack
committed
904fac2
feat(backend): surface scrape failures in /update and /health; add dispatchable GH scrape
KSaifStack
committed
a7d9163
fix(scraper): arbitrate the fingerprint unique constraint
KSaifStack
committed
f8c0d67
fix(scraper): make the fingerprint backfill greedy, not blind
KSaifStack
committed
5b55674
fix(scraper): correct the ON CONFLICT clause, assert the upsert shape
KSaifStack
committed
2455149
fix(scraper): arbitrate the upsert on (fingerprint), and create that constraint
KSaifStack
committed
2bf7863
fix(scraper): create the fingerprint index with IF NOT EXISTS, not ADD CONSTRAINT
KSaifStack
committed
3c220d6
chore(scraper): report how many rows the backfill left NULL
KSaifStack
committed
b95a0f6
fix(scraper): delete fingerprint-duplicate rows instead of leaving them NULL
KSaifStack
committed
8386e9b
chore(scraper): report the unique indexes and NULL-fingerprint count each run
KSaifStack
committed
b54d857
chore(scraper): print the losing row when the fingerprint arbiter is bypassed
KSaifStack
committed
0661ce9
chore(scraper): count rows whose stored fingerprint disagrees with the normaliser
KSaifStack
committed
37195c3
fix(scraper): reconcile every row's fingerprint, not just the NULL ones
KSaifStack
committed
d023fba