Skip to content

feat(VT-QUANT-FP8-GROUP): add vt::QuantFp8Group, the dynamic per-token per-group fp8 activation quant, CPU and CUDA (#1189) - #1212

Merged
localai-bot merged 4 commits into
mainfrom
row/VT-QUANT-FP8-GROUP
Aug 18, 2026
Merged

feat(VT-QUANT-FP8-GROUP): add vt::QuantFp8Group, the dynamic per-token per-group fp8 activation quant, CPU and CUDA (#1189)#1212
localai-bot merged 4 commits into
mainfrom
row/VT-QUANT-FP8-GROUP

merge: origin/main into row/VT-QUANT-FP8-GROUP

c265f37
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar