Skip to content

perf(cuda): half2 score kernel, two references per thread - #12

Merged
jayhesselberth merged 1 commit into
mainfrom
perf-cuda-half2
Oct 17, 2026
Merged

jayhesselberth merged 1 commit into
mainfrom
perf-cuda-half2

Conversation

@jayhesselberth

@jayhesselberth jayhesselberth commented Oct 17, 2026 •

Copy link
Copy Markdown
Member

On sm_80+ an fp16x2 kernel scores two references per thread for every read inside the new cuda::fits_f16 bound (min(n,L)·m + 2|o| + |e| ≤ 2048, ~420 for tRNA); the int kernel takes the rest in the same batch. Output is byte-identical: gpu_parity runs every check on both kernels, including positive-mismatch and free-gap schemes, and both deliberately broken variants fail it. Rebased onto #11 (its narrow tail stripe stays on the int kernel; the half2 kernel still walks a full 16-row tail — porting RR ∈ {16, 8, 4} to it is the obvious follow-up).

A30, examples/gpu_score_probe.rs, M1 reads vs the 164-ref panel, int kernel as of #11 vs half2:

Checks after the rebase, all in srun allocations: fmt, clippy with and without --features gpu, workspace tests 130/130 (rna); gpu_parity 5/5 (288,480 pairs equal on both kernels), CLI GPU tests 5/5, cuda unit tests 2/2 (A30).

Closes #9

🤖 Generated with Claude Code

@jayhesselberth
jayhesselberth merged commit 332aba6 into main Oct 17, 2026
5 checks passed
@jayhesselberth
jayhesselberth deleted the perf-cuda-half2 branch October 17, 2026 14:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

perf(cuda): half2 score kernel, two references per thread

1 participant