Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108
Open
AdamBien wants to merge 2 commits intobeehive-lab:mainfrom
Open
Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108AdamBien wants to merge 2 commits intobeehive-lab:mainfrom
AdamBien wants to merge 2 commits intobeehive-lab:mainfrom