Add idle model unload for mediapipe LLM graphs - #4486

Draft

atobiszei wants to merge 11 commits into

atobisze_refactor_servable_loadingfrom

atobisze_idle_servable_loading

Commits on Aug 28, 2026

Add idle model unload for mediapipe LLM graphs
atobiszei
committed
67dda0f
Extend idle model management to groups
atobiszei
committed
e844d84
spelling

dtrawins
authored and
atobiszei
committed
722d6ff
stype

dtrawins
authored and
atobiszei
committed
9d98be5
style

dtrawins
authored and
atobiszei
committed
479feab
fix

dtrawins
authored and
atobiszei
committed
542d3ff
fix

dtrawins
authored and
atobiszei
committed
58a7096
style

dtrawins
authored and
atobiszei
committed
920681e
build fix

dtrawins
authored and
atobiszei
committed
e78a175
initialization fix

dtrawins
authored and
atobiszei
committed
f9f6dc7
Make model group management use servable loading queue
atobiszei
committed
7df197b