feat(MODEL-FP8-BLOCK-WEIGHT): a block-wise FP8 checkpoint now LOADS, and says by name that it cannot run yet (#1189) - #1228

feat(MODEL-FP8-BLOCK-WEIGHT): a block-wise FP8 checkpoint now LOADS, and says by name that it cannot run yet (#1189)#1228

localai-bot merged 6 commits into

mainmudler/vllm.cpp:mainfrom

row/MODEL-FP8-BLOCK-WEIGHTmudler/vllm.cpp:row/MODEL-FP8-BLOCK-WEIGHTCopy head branch name to clipboard