Repository navigation

Add `prefill` method support without generation - #183

Closed

craftingmod wants to merge 13 commits into

JamePeng:mainfrom

craftingmod:prefill-feature

Closed

Add `prefill` method support without generation#183
craftingmod wants to merge 13 commits into
JamePeng:mainfrom
craftingmod:prefill-feature

Commits on Sep 26, 2026
- feat(mtmd): support `prefill` mode
  craftingmod
  committed
  6277c21
- feat(mtmd): add `create_chat_prefill` public API with immutable result
  craftingmod
  committed
  8ba5579
- chore: add `chat completion handler` method in test
  craftingmod
  committed
  d967725
- feat: support prefill both MTMD and text.
  craftingmod
  committed
  803f448
- feat(chat): add `chat_template_kwargs` option to chat completion & prefill
  craftingmod
  committed
  3c3cab2
- chore(prefill): add example for prefill feature
  craftingmod
  committed
  5712f67
- test: add `chat_template_kwargs` override test
  craftingmod
  committed
  dc5f528
- chore: fix `chat_template_kwargs` parameter error
  craftingmod
  committed
  33d0d2c
Commits on Sep 27, 2026
- chore(prefill): add `n_tokens` field again
  craftingmod
  committed
  399fbb1
Commits on Oct 1, 2026
- Revert `chat_template_kwargs` option
  craftingmod
  committed
  d40e2d6
- Revert "test: add `chat_template_kwargs` override test"
  craftingmod
  committed
  14b89b2
- Merge branch 'main' into prefill-feature
  craftingmod
  committed
  8030f77
- feat: support `grammer` parameter on prefill
  craftingmod
  committed
  e9e751d