Add idle model unload for mediapipe LLM graphs - #4486

Add idle model unload for mediapipe LLM graphs#4486

atobiszei wants to merge 12 commits into

atobisze_refactor_servable_loadingopenvinotoolkit/model_server:atobisze_refactor_servable_loadingfrom

atobisze_idle_servable_loadingopenvinotoolkit/model_server:atobisze_idle_servable_loadingCopy head branch name to clipboard