Skip to content

feat: support progressive snapshots and stable page citations - #139

Merged
suguanYang merged 5 commits into
mainfrom
feat/wangbinqi/progressive-snapshots
Oct 27, 2026
Merged

suguanYang merged 5 commits into
mainfrom
feat/wangbinqi/progressive-snapshots

Conversation

@suguanYang

@suguanYang suguanYang commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Progressive ingestion returns a readable baseline before enhancement completes. Expose enhancement status, retry, immutable baseline/final snapshots, and source-page citation coordinates in the Node SDK.

Synchronize each snapshot under an independent revision key with archive SHA-256 verification, resumable checkpoints, retained historical reads, and a current-reader pointer updated after local commit. Superseded progressive/full Jobs cannot select an older original-file revision. Preserve the first local baseline while final copying is pending. Document external serialization requirements for current-pointer writes across processes or separate storage adapter instances.

Verification

  • SDK: 460 tests passed; MCP: 18 tests passed.
  • SDK/MCP typecheck, lint, build, and formatting checks passed; existing lint warnings remain.
  • Changeset check passed.
  • Controlled regressions reproduced historical synchronization replacing current reads before the fix; baseline/final reordering and explicit historical reads pass.

Release notes

Includes a minor-release changeset. Publish the compatible SDK before pinning it in Hipo; this PR does not publish a package.

Checklist

  • Tests updated for changed behavior
  • Public types and synchronization documentation updated
  • Changeset included

Related server: Ontos-AI/knowhere#478
Related Hipo integration: https://github.com/Ontos-AI/hipo/pull/408 (Draft pending SDK publication/pin).

@suguanYang
suguanYang merged commit 16cc319 into main Oct 27, 2026
4 checks passed
@github-actions github-actions Bot mentioned this pull request Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant