Skip to content

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108

Open
AdamBien wants to merge 2 commits intobeehive-lab:mainfrom
AdamBien:main
Open

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108
AdamBien wants to merge 2 commits intobeehive-lab:mainfrom
AdamBien:main

Commits

Commits on Apr 19, 2026