Skip to content
#

kv-cache-optimization

Star

Here are 3 public repositories matching this topic...

Language: All
Filter by language
All 3 Python 2 Cuda 1

manishklach / intent-attention-kernel

Star 1

Intent-aware KV execution prototype for agentic long-context inference: semantic block selection, dynamic scoring, KV quantization modeling, speculative prefetch simulation, CPU references, and future Triton/CUDA kernels.

cost-model triton memory-bandwidth gpu-kernels mixed-precision prefetching inference-optimization kv-cache sparse-attention long-context paged-attention semantic-routing agentic-ai block-sparse-attention kernel-research block-attention semantic-attention kv-quantization paged-kv kv-cache-optimization
  • Updated May 29, 2026
  • Python

PJHkorea / Continuous_Wave_Field_LLM_Brain

Star 0

True Forward-Only Autograd-Free Wave-Field LLM Swappable Plug-in Architecture. 1-Cycle FMA hardware interlock bridge for decoupling and replacing Transformer Attention/KV-Cache via viscous Burgers' and Vorticity fluid dynamics.

zero-copy transformer high-performance-computing fluid-dynamics forward-only pybind11 plugin-architecture pinn burgers-equation jax vorticity cuda-kernel hardware-software-codesign llm backpropagation-free vram-optimization kv-cache-optimization xla-compiler autograd-free
  • Updated Jul 18, 2026
  • Python

Improve this page

Add a description, image, and links to the kv-cache-optimization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the kv-cache-optimization topic, visit your repo's landing page and select "manage topics."

Learn more