Skip to content

feat: Native Speculative Decoding & MTP (Multi-Token Prediction) - #1431

Open
zsogitbe wants to merge 6 commits into
SciSharp:masterfrom
zsogitbe:SpeculativeDecodingLLamaSharp
Open

zsogitbe wants to merge 6 commits into
SciSharp:masterfrom
zsogitbe:SpeculativeDecodingLLamaSharp

update benchmark

e2260df
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

3 warnings and 1 notice
Spell check
succeeded Sep 24, 2026 in 5s