Skip to content
#

vram-optimizer

Here are 4 public repositories matching this topic...

Language: All
Filter by language

The Unified Latent-State Memory Fabric (UL-SMF) is a hardware-software co-designed memory compression fabric that solves the memory bottleneck in long-context Transformer inference. By combining FSQ with dynamic 16-dimensional latent mapping, UL-SMF compresses Key-Value (KV) cache tensors by up to 384x while maintaining >94% semantic retention.

  • Updated Aug 23, 2026
  • Python

Improve this page

Add a description, image, and links to the vram-optimizer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vram-optimizer topic, visit your repo's landing page and select "manage topics."

Learn more