Skip to content

Reuse MLX's prompt cache after an edit and survive exact cache hits (stacked on #868) - #876

Open
senadaruc wants to merge 12 commits into
FuJacob:mainfrom
senadaruc:perf/mlx-prompt-cache
Open

Reuse MLX's prompt cache after an edit and survive exact cache hits (stacked on #868)#876
senadaruc wants to merge 12 commits into
FuJacob:mainfrom
senadaruc:perf/mlx-prompt-cache

Keep the MLX server alive on an exact prompt-cache hit

6feec96
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
xcodebuild (macOS)
succeeded Oct 18, 2026 in 2m 27s