Prefill/decode disaggregation design - #116

Merged

dennis-upbound merged 10 commits into

mainfrom

dennis/disagg-design

Jun 11, 2026

Commits on Jun 9, 2026

Commits on Jun 10, 2026

Address design review feedback on disaggregation

dennis-upbound
and
claude
committed
909c2ed
Fold the confirmed disaggregation routing design into the doc

dennis-upbound
and
claude
committed
6bc1e2a
Explain InferencePool, the gateway choice, and the role labels

dennis-upbound
and
claude
committed
4fea498
Reflect the 1:1 default ratio and fix the NIC count in the example

dennis-upbound
and
claude
committed
7ca8ffd
Frame the gateway as a pluggable default, not a least-change choice
dennis-upbound
committed
0e34d15
Make routing a first-class explicit block; require explicit counts

dennis-upbound
and
claude
committed
b2e4210