Use proxies for all core Worker YouTube extraction - #101
Merged
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem / Motivation
Direct YouTube requests can delay transcript retrieval before the Worker reaches a working proxy. In the reported session, the direct attempt consumed eight seconds before proxy extraction succeeded. This follow-up to merged PR #99 removes that initial attempt.
What changed
Every core Worker extraction attempt now uses the configured proxy pool. Eligible failures retain up to four proxy attempts, rotating across configured gateways before repeating. Missing proxy configuration fails before any YouTube request instead of silently using direct access.
The direct timeout setting is removed. Existing proxy and total timeouts remain unchanged. PR #100's timeout changes are excluded. Frames, storyboards and caching are unchanged.
flowchart LR B[Before: Worker] --> D[Direct attempt, removed] D --> P[Proxy pool, retained] A[After: Worker] --> P P --> Y[YouTube] style D fill:#fee2e2,color:#7f1d1d,stroke:#b91c1c style P fill:#dbeafe,color:#1e3a8a,stroke:#1d4ed8Core extraction now starts with the existing proxy pool.
Tests
Platform build, generated types and documentation checks passed. All 817 platform unit tests passed, with 11 existing skips. Coverage includes proxy routing, retries, missing configuration and cancellation.
The temporary deployed Worker passed all 17 extraction cases and both certificate checks. Ordinary transcripts took 2.0–3.0 seconds; French translation took 8.1 seconds across three proxy attempts. The temporary Worker was deleted. See
reference/engineering/WORKER_EXTRACTION_RESULTS.md.Deployment
Merge and deploy normally. Existing production proxy secrets are reused; no new toggle is required. Monitor uncached latency and success rate; proxies can still be slow.