Repository navigation
feat(gallery): add MOSS-Image and wire tokenizer option - #12757
Merged
Merged
Conversation
stable-diffusion.cpp PR #2148 added MOSS-Image support, which needs an external tokenizer file passed via the --tokenizer CLI arg. The C++ binding (gosd.cpp) never parsed a tokenizer option nor set ctx_params.tokenizer, so MOSS-Image could not load through LocalAI. - Wire the "tokenizer" option in gosd.cpp (parse + assign to ctx_params) - Resolve "tokenizer:..." paths against the model directory in gosd.go, the same way *_path options are resolved - Bump the vendored stable-diffusion.cpp to 68285df (moss-image merge) - Add moss-image-base and moss-image-sft gallery entries (int8_convrot) FLUX.3 Image Klein is already in the gallery (added in #12736).
mudler
approved these changes
Oct 18, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds MOSS-Image (Base + SFT) to the model gallery and wires the
tokenizeroption that MOSS-Image needs through the stablediffusion-ggml backend.Upstream stable-diffusion.cpp PR #2148 added MOSS-Image support. MOSS-Image requires an external tokenizer file passed via
--tokenizer. The C++ binding (gosd.cpp) never parsed atokenizeroption nor setctx_params.tokenizer, so MOSS-Image could not load through LocalAI.Changes
gosd.cpp: parse thetokenizeroption and assign it toctx_params.tokenizergosd.go: resolvetokenizer:...option paths against the model directory (same as*_pathoptions), so gallery entries can use a relative pathMakefile: bump vendored stable-diffusion.cpp from8cd731e→68285df(the moss-image merge commit)gallery/index.yaml: addmoss-image-baseandmoss-image-sftentries (int8_convrot quantization, ~5.4 GB each)FLUX.3
FLUX.3 Image Klein (Q4_K_M + Q8_0) and Klein Base (Q4_K_M + Q8_0) are already in the gallery — added in #12736.
How to verify
The gallery entries use:
moss_image_base_int8_convrot.safetensors/moss_image_sft_int8_convrot.safetensorsfromComfy-Org/MOSS-Imagetokenizer.jsonfromOpenMOSS-Team/MOSS-Image-BaseThe sha256 for the large diffusion model files will be filled in by the checksum CI bot.