Repository navigation
Correct the narrow-file row count (106 M → 101,387,180) and the figures derived from it - #349
Conversation
Four public docs said the 202512 narrow parquet has "106 M" rows. The file has 101,387,180 (scripts/isamples_facts.py, verified 2026-07-18 and 2026-08-25 against both the local copy and the R2-served file; the Zenodo staging README/MANIFEST already carry the correct figure). Numbers only; no other wording changed. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GcdPqoUz6h6iyHeyXe1uni
…imal MB Codex review of isamplesorg#349 flagged numbers that were computed from '106 M' or from an older, smaller narrow file, plus sizes that were MiB labelled as MB. Live sizes (Content-Length, 2026-08-27): narrow 860,063,694 B; wide 291,818,634 B; wide_h3 306,553,295 B. Edge rows = 101,387,180 - 20,729,358 = 80,657,822 (79.6 %). - tutorial: ~9M edge rows -> ~81M; 60% -> ~66% size reduction; ~79% -> ~80% fewer rows; 691 MB -> 860 MB; table sizes 850/278/292 -> 860/292/307 MB - how-to-use: 820 MB -> 860 MB (narrow), 292 -> 307 MB (wide_h3) - README: 280/850 MB -> 292/860 MB - DATA_PROVENANCE: ~844MB/~282MB -> ~860MB/~292MB Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…> 20.7M; H3 delta ~15MB Codex round-2 findings on isamplesorg#349. 20,729,358 rows is 20.7 M, not 20 M; wide_h3 - wide = 14,734,661 B = 14.7 MB -> ~15MB. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
🤖 rbotyee (Claude, operated by @rdhyee) — Raymond's intent: have Codex adversarially review this PR and iterate until both reviewers say LGTM before he merges. What I did: four Codex rounds (gpt-5.4 default model, reviewing a clean clone of this branch), fixing what each round found and pushing; then applied the Codex verdict at
What the rounds caught (all fixed): figures derived from the old 106 M ( Round transcripts are local ( |
🤖 rbotyee (Claude, operated by @rdhyee) — Raymond's intent: fix a known stale figure in the public docs during the 2026-08 solidify pass, and get this PR to a CC×Codex LGTM before a human merges. What I did: replaced "106 M" / "~106M rows" with the verified count 101,387,180 in the four places it appears (commit 1); then, after an adversarial Codex review, fixed the figures in the same four files that had been derived from the wrong count or from an older, smaller file, and standardized their sizes to decimal MB (commit 2).
Evidence
isamples_202512_narrow.parquethas 101,387,180 rows —scripts/isamples_facts.py(2026-07-18, 2026-08-25) and a live DuckDBcount(*)againstdata.isamples.orgon 2026-08-27.Content-Length, 2026-08-27): narrow 860,063,694 B; wide 291,818,634 B; wide_h3 306,553,295 B. The old "292 MB / 820 MB" figures were MiB labelled as MB; "691 MB" and "~9M edge rows" were from an earlier file.Files
how-to-use.qmd(file table: rows, sizes)README.md(JavaScript snippet comments)tutorials/narrow_vs_wide_performance.qmd(format table; "~79 %" → ~80 %; "~9M edge rows (60 %)" → ~81M (~66 %); "691 MB" → 860 MB)DATA_PROVENANCE.md(pipeline diagram)Numbers only; no prose or code changes. Draft, for a human to merge.
🤖 Generated with Claude Code
https://claude.ai/code/session_01QJzwMsuFoSgTxX2p9paToy