Skip to content

Support request-level cache for hybrid sliding-window attention - #1545

Open
shihaobai wants to merge 13 commits into
mainfrom
bsh/hybrid-sliding-window-cache
Open

Support request-level cache for hybrid sliding-window attention#1545
shihaobai wants to merge 13 commits into
mainfrom
bsh/hybrid-sliding-window-cache

refactor: unify hybrid checkpoint cache managers

5c6edc6
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar