alexreinking/ggml app - #9417

Draft

alexreinking wants to merge 22 commits into

alexreinking/struct-typesfrom

alexreinking/ggml-app

Commits on Sep 4, 2026

hoist_invariants(): return one Func per accumulator, not a Tuple

alexreinking
and
claude
committed
b00e38e
Add Stage::distribute()

alexreinking
and
claude
committed
bc98aa4
Add Pipeline::compute_offline() directive

alexreinking
and
claude
committed
e671fd8
Add Func::approximate_by() directive and Approximation combinators

alexreinking
and
claude
committed
9f4a678
Add apps/ggml: Halide reimplementation of GGML quant kernels

alexreinking
and
claude
committed
a38f662
apps/ggml: struct-type the symmetric codec block layout (Phase 3 pilot)

alexreinking
and
claude
committed
bc36efa
apps/ggml: restore SDOT vec-dot via deep decode-chain inlining

alexreinking
and
claude
committed
7cad243
apps/ggml: efficient SDOT schedule for repack gemv/gemm

alexreinking
and
claude
committed
9a5fa5e
apps/ggml: struct-type the symmetric vec_dot weight operand

alexreinking
and
claude
committed
72ac306
apps/ggml: cast int8 codes straight to float in LinearDequant (enables SDOT)

alexreinking
and
claude
committed
00d21ff
apps/ggml: bring q4_0/q8_0 vec_dot up to ggml-cpu speed

alexreinking
and
claude
committed
9855563
apps/ggml: take the affine vec_dots (q4_1, q5_1) to SDOT

alexreinking
and
claude
committed
a0a449a
apps/ggml: propagate hoist_invariants()'s vector<Func> return through sdot_partial()

alexreinking
and
claude
committed
72330ec
apps/ggml: notes for resuming the vec_dot performance work

alexreinking
and
claude
committed
fdb5376
apps/ggml: sever q4_1/q5_1 offset term to Q8_1's stored block sum

alexreinking
and
claude
committed
bdb0229
apps/ggml: expand q5_x qh high bit via a compile-time LUT (0.51->0.63x)

alexreinking
and
claude
committed
4b01ba2
apps/ggml: q5_0/q5_1 no_asserts + register-resident codes (0.63->0.69x, 0.68->0.78x)

alexreinking
and
claude
committed
2672e7a
apps/ggml: q5_0 vec_dot ABI wrapper on StackBuffer (166->155 ns)

alexreinking
and
claude
committed
e2dc0aa
Improve q5_0/q5_1 performance (note: breaks contracts)
alexreinking
committed
9a2f4fa
Checkpoint
alexreinking
committed
3e57421
Checkpoint
alexreinking
committed
c4de4f8
Manual cleanup
alexreinking
committed
9bd41cc

Navigation Menu

Uh oh!

alexreinking/ggml app - #9417

alexreinking/ggml app#9417
alexreinking wants to merge 22 commits into
alexreinking/struct-typesfrom
alexreinking/ggml-app

Commits on Sep 4, 2026

hoist_invariants(): return one Func per accumulator, not a Tuple

Add Stage::distribute()

Add Pipeline::compute_offline() directive

Add Func::approximate_by() directive and Approximation combinators

Add apps/ggml: Halide reimplementation of GGML quant kernels

apps/ggml: struct-type the symmetric codec block layout (Phase 3 pilot)

apps/ggml: restore SDOT vec-dot via deep decode-chain inlining

apps/ggml: efficient SDOT schedule for repack gemv/gemm

apps/ggml: struct-type the symmetric vec_dot weight operand

apps/ggml: cast int8 codes straight to float in LinearDequant (enables SDOT)

apps/ggml: bring q4_0/q8_0 vec_dot up to ggml-cpu speed

apps/ggml: take the affine vec_dots (q4_1, q5_1) to SDOT

apps/ggml: propagate hoist_invariants()'s vector<Func> return through sdot_partial()

apps/ggml: notes for resuming the vec_dot performance work

apps/ggml: sever q4_1/q5_1 offset term to Q8_1's stored block sum

apps/ggml: expand q5_x qh high bit via a compile-time LUT (0.51->0.63x)

apps/ggml: q5_0/q5_1 no_asserts + register-resident codes (0.63->0.69x, 0.68->0.78x)

apps/ggml: q5_0 vec_dot ABI wrapper on StackBuffer (166->155 ns)

Improve q5_0/q5_1 performance (note: breaks contracts)

Checkpoint

Checkpoint

Manual cleanup