Skip to content

support for Q4 quantization added

58f7e2a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization #108

support for Q4 quantization added
58f7e2a
Select commit
Loading
Failed to load commit list.

Annotations

1 warning
code-quality
succeeded Apr 19, 2026 in 15s