Skip to content

codex/parallel plugin instances - #18

Merged
ketan0 merged 1 commit into
codex/stream-summary-updatesfrom
codex/parallel-plugin-instances
Sep 19, 2026
Merged

ketan0 merged 1 commit into
codex/stream-summary-updatesfrom
codex/parallel-plugin-instances

Conversation

@ketan0

@ketan0 ketan0 commented Sep 19, 2026 •

Copy link
Copy Markdown
Contributor

Allow plugins declaring parallel = true to run deferred jobs on independent instances, with a host-owned instances limit shared across files. Opted-in plugins default to four instances; other plugins remain serial. Plugin order within a file remains sequential.

Compile WASM once and lease separate stores/resources. With parallelism enabled, use a separate initial-presentation instance so busy summaries do not block initial folds. The summarizer still batches each file's folds into one request; requests overlap across files.

Validated bounded overlap, lease return after errors, initial presentation during enrichment, native/plugin integration tests, and real WASM requests: six files peaked at three concurrent requests with instances=3 versus one with instances=1.

AI-assisted implementation and review by Codex.

@ketan0
ketan0 added this pull request to stack #19 September 19, 2026 08:58
@ketan0 ketan0 changed the title codex/parallel plugin instances (wip) codex/parallel plugin instances Sep 19, 2026
@ketan0
ketan0 marked this pull request as ready for review September 19, 2026 18:43
@ketan0 ketan0 changed the title (wip) codex/parallel plugin instances codex/parallel plugin instances Sep 19, 2026
@ketan0
ketan0 force-pushed the codex/parallel-plugin-instances branch from 26aed20 to d47882e Compare September 19, 2026 21:07
@ketan0
ketan0 force-pushed the codex/parallel-plugin-instances branch from d47882e to d196a8c Compare September 19, 2026 21:20
Compile components once and bound deferred calls across files, reserving an initial-presentation instance so model latency cannot block initial folds. Serial plugins retain one instance. AI-assisted implementation with Codex.
@ketan0
ketan0 force-pushed the codex/parallel-plugin-instances branch from d196a8c to c9ea0bf Compare September 19, 2026 22:54
@ketan0
ketan0 merged commit a701588 into main Sep 19, 2026
42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants