Skip to content

feat(ENG-RESIDENCY-CONFIG): the device budget is a config key, and --offload-config reaches vllm-cli and the pooling server (#1127, #1135) - #1216

Merged
localai-bot merged 17 commits into
mainfrom
row/ENG-RESIDENCY-CONFIG-W2
Aug 18, 2026
Merged

feat(ENG-RESIDENCY-CONFIG): the device budget is a config key, and --offload-config reaches vllm-cli and the pooling server (#1127, #1135)#1216
localai-bot merged 17 commits into
mainfrom
row/ENG-RESIDENCY-CONFIG-W2

Commits

Commits on Aug 18, 2026