Cut keystroke-to-ghost latency on the llama engine to under 60 ms - #875

Cut keystroke-to-ghost latency on the llama engine to under 60 ms#875

senadaruc wants to merge 19 commits into

FuJacob:mainFuJacob/cotabby:mainfrom

senadaruc:perf/llama-cache-and-latencysenadaruc/cotabby:perf/llama-cache-and-latencyCopy head branch name to clipboard