Skip to content

fix: load padding tokens serialized as AddedToken objects - #800

Open
WitBlue6 wants to merge 3 commits into
qdrant:mainfrom
WitBlue6:fix/added-token-padding-config
Open

fix: load padding tokens serialized as AddedToken objects#800
WitBlue6 wants to merge 3 commits into
qdrant:mainfrom
WitBlue6:fix/added-token-padding-config

test: assert serialized padding metadata and document tokenizer loading

567c60d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs