Skip to content

Use proxies for all core Worker YouTube extraction - #101

Merged
devhims merged 1 commit into
mainfrom
fix/proxy-only-extraction
Sep 27, 2026
Merged

devhims merged 1 commit into
mainfrom
fix/proxy-only-extraction

Conversation

@devhims

@devhims devhims commented Sep 27, 2026 •

Copy link
Copy Markdown
Owner

Problem / Motivation

Direct YouTube requests can delay transcript retrieval before the Worker reaches a working proxy. In the reported session, the direct attempt consumed eight seconds before proxy extraction succeeded. This follow-up to merged PR #99 removes that initial attempt.

What changed

Every core Worker extraction attempt now uses the configured proxy pool. Eligible failures retain up to four proxy attempts, rotating across configured gateways before repeating. Missing proxy configuration fails before any YouTube request instead of silently using direct access.

The direct timeout setting is removed. Existing proxy and total timeouts remain unchanged. PR #100's timeout changes are excluded. Frames, storyboards and caching are unchanged.

flowchart LR
    B[Before: Worker] --> D[Direct attempt, removed]
    D --> P[Proxy pool, retained]
    A[After: Worker] --> P
    P --> Y[YouTube]
    style D fill:#fee2e2,color:#7f1d1d,stroke:#b91c1c
    style P fill:#dbeafe,color:#1e3a8a,stroke:#1d4ed8
Loading

Core extraction now starts with the existing proxy pool.

Tests

Platform build, generated types and documentation checks passed. All 817 platform unit tests passed, with 11 existing skips. Coverage includes proxy routing, retries, missing configuration and cancellation.

The temporary deployed Worker passed all 17 extraction cases and both certificate checks. Ordinary transcripts took 2.0–3.0 seconds; French translation took 8.1 seconds across three proxy attempts. The temporary Worker was deleted. See reference/engineering/WORKER_EXTRACTION_RESULTS.md.

Deployment

Merge and deploy normally. Existing production proxy secrets are reused; no new toggle is required. Monitor uncached latency and success rate; proxies can still be slow.

@vercel

vercel Bot commented Sep 27, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
video2ctx-web Ready Ready Preview Sep 27, 2026 8:51am UTC

@devhims
devhims merged commit 305ccc7 into main Sep 27, 2026
10 checks passed
@devhims
devhims deleted the fix/proxy-only-extraction branch September 27, 2026 08:53

This branch was successfully deployed

1 active deployment
Preview — df021412 Deployed Sep 27, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant