You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
gpu-gates: q8_2 quantization silently drops a partial block #175
The unchanged loop in ik_q8_2::quantize walks only x.as_chunks::<32>().0. Passing 33 finite values returns 32 codes and one scale without an error. gate_deepseek41_step::v_q8_2 then indexes q[c] for every input value; the Q8_0 project functions also ignore the partial block. The whole-block check lives in reconstruct, so direct callers bypass it. Add that named assertion to quantize and pin rejection of a 33-value input.
I'll take this first once our open pull requests (#164, #172, #173 and #174) are merged. #174 changes crates/gpu-gates/src/ik_q8_2.rs, where quantize lives, so the fix goes on top of it.
Activity
juliankang4 commentedon Oct 14, 2026
I'll take this first once our open pull requests (#164, #172, #173 and #174) are merged. #174 changes
crates/gpu-gates/src/ik_q8_2.rs, wherequantizelives, so the fix goes on top of it.