Skip to content

gantry: bound detached origin pulls by progress - #801

Open
Vaibhav Patel (vpatelsj) wants to merge 1 commit into
vapa/gantry-large-layer-01-http-timeoutsfrom
vapa/gantry-large-layer-02-detached-progress
Open

Vaibhav Patel (vpatelsj) wants to merge 1 commit into
vapa/gantry-large-layer-01-http-timeoutsfrom
vapa/gantry-large-layer-02-detached-progress

Conversation

@vpatelsj

@vpatelsj Vaibhav Patel (vpatelsj) commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

Summary

Replace the five-minute size formula and 30-minute absolute detached-pull budget with a reset-on-read response-body progress watchdog. Add origin_pull_progress_timeout with a five-minute default and explicit zero-to-disable semantics through YAML, environment, flags, and the shipped ConfigMap. Keep the containerd remote writer on the detached context for its full write and commit lifetime. This is one commit.

Scope

Excludes Range support, partial-ingest resume, and separate writer/commit timeout policy.

Validation

  • go test ./internal/gantry/config ./cmd/gantry -count=1
  • Focused progress and writer-context tests repeated 20 times
  • Focused race detector
  • Focused golangci-lint
  • make gantry-manifests

Stack

2/6. Depends on #800. Next layer: #802.

@vpatelsj
Vaibhav Patel (vpatelsj) requested a review from a team as a code owner September 17, 2026 03:36
@vpatelsj
Vaibhav Patel (vpatelsj) force-pushed the vapa/gantry-large-layer-02-detached-progress branch from 680532c to a690706 Compare September 17, 2026 12:14
@vpatelsj

Copy link
Copy Markdown
Contributor Author

E2E failure root cause: the initial implementation canceled the context passed to containerd ContentStore.Writer immediately after Writer returned. containerd retains that context for the remote writer stream, so later writes failed and no background ingest lease appeared. The updated commit keeps the context alive through write and commit and adds TestRunOriginPullKeepsWriterContextAlive.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants