Add from_single_file() support for Ideogram4 transformer by buffett0323 · Pull Request #14126 · huggingface/diffusers

buffett0323 · 2026-07-06T02:05:04Z

What does this PR do?

Adds from_single_file() support for Ideogram4Transformer2DModel and
Krea2Transformer2DModel.

Fixes #14122

Before submitting

Did you use an AI agent (Claude Code, Codex, Cursor, etc.) to help with this PR? If so:
- Did you read the Coding with AI agents guide?
- Did you self-review the diff against .ai/review-rules.md?
Did you read the contributor guideline?
Did you read our philosophy doc? (important for complex PRs)
Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
- Issue: from_single_file() support missing/incomplete for Ideogram4 and Krea2 transformers #14122
Did you make sure to update the documentation with your changes?
Did you write any new necessary tests?
Are you the author (or part of the team) of the model/pipeline (only applicable for model/pipeline related PRs)?

Who can review?

@sayakpaul @yiyixuxu @DN6

DN6 · 2026-07-07T16:45:04Z

            checkpoint[k.replace("model.diffusion_model.", "")] = checkpoint.pop(k)

    return checkpoint
+


Could we add a check to infer the model type automatically

diffusers/src/diffusers/loaders/single_file_utils.py

Line 586 in d1b988b

def infer_diffusers_model_type(checkpoint):

@DN6
Sure, I just added in my newest commit, please check, thanks!

buffett0323 · 2026-07-16T20:10:54Z

@DN6 Sorry to bother you, I updated the code changes. I would appreciate your help for reviewing, thanks for your time!

spartanz51 · 2026-07-21T09:53:58Z

Ran into a gap while testing GGUF loading on top of this branch: the community GGUF exports (vantagewithai, realrebelai) keep the native krea-ai/krea-2 key names (prenorm/postnorm.scale, attn.qknorm.*, flat mod.lin, first/tmlp/tproj/txtmlp/last), which fall through remap_key and fail on meta tensors. Opened #14264 on top of your branch with the extra mappings

Feel free to cherry-pick into this PR if you'd rather keep everything in one place.

…ingle-file conversion

buffett0323 · 2026-07-23T08:09:42Z

@DN6 Pushed an update, cherry-picked #14264 from @spartanz51 to add support for the native krea-ai/krea-2 key layout used by community GGUF exports. Ready for another look whenever you have time, thanks!

hameerabbasi · 2026-08-03T11:29:25Z

cc @DN6 Having this in would be nice.

buffett0323 · 2026-08-20T00:19:06Z

Hi @DN6 , Sorry to bother you again, gentle reminder for this PR whenever you get a chance! Let me know if you have any questions or feedback. Thanks again for your help!!

O-J1 · 2026-10-12T04:26:01Z

Hi @DN6 we have end users asking about this and having this feature (assuming the code is acceptable) would be great, any chance of this getting merged?

…14914

buffett0323 · 2026-10-17T04:50:52Z

Hi @DN6 , Sorry to bother you again, gentle reminder for this PR whenever you get a chance! I solved the conflict against main, please let me know if you have any questions or feedback. Thanks again for your help!!

hameerabbasi

There were a bunch of issues in the merge commit. I'd resolve these before proceeding, this PR removes code that in principle shouldn't be touched as it stands.

hameerabbasi · 2026-10-17T06:04:20Z

-    "flux3": [
-        "model.diffusion_model.early_stream_modulations.image.lin.weight",
-        "early_stream_modulations.image.lin.weight",
-    ],
-    "flux3-distilled": ["model.diffusion_model.ref_time_in.in_layer.weight", "ref_time_in.in_layer.weight"],
-    "chroma": [
-        "model.diffusion_model.distilled_guidance_layer.in_proj.bias",
-        "distilled_guidance_layer.in_proj.bias",


These probably shouldn't be dropped.

hameerabbasi · 2026-10-17T06:05:00Z

-    "qwen-image-2.1": {"pretrained_model_name_or_path": "Qwen/Qwen-Image-2.1"},
-    "krea2": {"pretrained_model_name_or_path": "krea/Krea-2-Raw"},
-    "minimax-h3": {"pretrained_model_name_or_path": "MiniMaxAI/MiniMax-H3"},
+    "ideogram4": {"pretrained_model_name_or_path": "ideogram-ai/ideogram-v4"},


hameerabbasi · 2026-10-17T06:05:16Z

-    elif any(key in checkpoint for key in CHECKPOINT_KEY_NAMES["flux3"]):
-        # the step-distilled (flow-map) checkpoint carries a second timestep embedder
-        if any(key in checkpoint for key in CHECKPOINT_KEY_NAMES["flux3-distilled"]):
-            model_type = "flux-3-image-distilled"
-        else:
-            model_type = "flux-3-image"


hameerabbasi · 2026-10-17T06:05:25Z

-    elif any(key in checkpoint for key in CHECKPOINT_KEY_NAMES["chroma"]):
-        model_type = "chroma"


buffett0323 · 2026-10-17T08:13:58Z

@hameerabbasi All solved, thanks for your help!

hameerabbasi · 2026-10-17T08:20:49Z

Wait; the Krea2 stuff is now no longer in the PR. 👀 Only Ideogram 4.

buffett0323 · 2026-10-17T10:05:58Z

Yes, that's intentional. Krea2 single-file support already landed on main in #14914 , and I've changed the title, thanks for the clarification! @hameerabbasi

hameerabbasi

LGTM (but I don't have approve or merge rights)

buffett0323 · 2026-10-23T02:48:11Z

@DN6 can you please help review again? thanks a lot!

github-actions Bot added documentation Improvements or additions to documentation models tests single-file fixes-issue size/L PR with diff > 200 LOC labels Jul 6, 2026

sayakpaul requested a review from DN6 July 6, 2026 02:42

DN6 reviewed Jul 7, 2026

View reviewed changes

buffett0323 added 4 commits July 8, 2026 22:44

support missing/incomplete for Ideogram4 and Krea2 transformers

b5f28a5

support missing/incomplete for Ideogram4 and Krea2 transformers

890ba0e

Docs added for Ideogram4 and Krea2 transformers

0bcfd44

Add automatic check to infer the model type

b741167

buffett0323 force-pushed the fix/single-file-ideogram4-krea2 branch from ca7e3e7 to b741167 Compare July 9, 2026 05:45

spartanz51 mentioned this pull request Jul 21, 2026

Support native-layout Krea2 checkpoints (community GGUFs) in from_single_file() #14264

Open

Support native-layout Krea2 checkpoints (community GGUF exports) in s…

824546b

…ingle-file conversion

Merge branch 'main' into fix/single-file-ideogram4-krea2

abcd186

Koratahiu mentioned this pull request Oct 12, 2026

Support loading single-file Krea2 models Nerogar/OneTrainer#1733

Open

Koratahiu mentioned this pull request Oct 12, 2026

Support loading separate cond/uncond single-file Ideogram4 models Nerogar/OneTrainer#1734

Draft

1 task done

buffett0323 and others added 2 commits October 17, 2026 12:37

Merge upstream/main and drop Krea2 changes superseded by huggingface#…

823e04c

…14914

Merge branch 'main' into fix/single-file-ideogram4-krea2

9ccca98

github-actions Bot removed the models label Oct 17, 2026

hameerabbasi suggested changes Oct 17, 2026

View reviewed changes

Restore upstream single-file entries dropped in web conflict resolution

4328401

Add tests for Ideogram4 model type inference

1112a89

buffett0323 changed the title ~~Add from_single_file() support for Ideogram4 and Krea2 transformers~~ Add from_single_file() support for Ideogram4 transformer Oct 17, 2026

hameerabbasi approved these changes Oct 21, 2026

View reviewed changes

		checkpoint[k.replace("model.diffusion_model.", "")] = checkpoint.pop(k)

		return checkpoint

		elif any(key in checkpoint for key in CHECKPOINT_KEY_NAMES["chroma"]):
		model_type = "chroma"

Conversation

buffett0323 commented Jul 6, 2026

What does this PR do?

Before submitting

Who can review?

Uh oh!

DN6 Jul 7, 2026

Choose a reason for hiding this comment

Uh oh!

buffett0323 Jul 9, 2026

Choose a reason for hiding this comment

Uh oh!

buffett0323 commented Jul 16, 2026

Uh oh!

spartanz51 commented Jul 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

buffett0323 commented Jul 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hameerabbasi commented Aug 3, 2026

Uh oh!

buffett0323 commented Aug 20, 2026

Uh oh!

O-J1 commented Oct 12, 2026

Uh oh!

buffett0323 commented Oct 17, 2026

Uh oh!

hameerabbasi left a comment

Choose a reason for hiding this comment

Uh oh!

hameerabbasi Oct 17, 2026

Choose a reason for hiding this comment

Uh oh!

hameerabbasi Oct 17, 2026

Choose a reason for hiding this comment

Uh oh!

hameerabbasi Oct 17, 2026

Choose a reason for hiding this comment

Uh oh!

hameerabbasi Oct 17, 2026

Choose a reason for hiding this comment

Uh oh!

buffett0323 commented Oct 17, 2026

Uh oh!

hameerabbasi commented Oct 17, 2026

Uh oh!

buffett0323 commented Oct 17, 2026

Uh oh!

hameerabbasi left a comment

Choose a reason for hiding this comment

Uh oh!

buffett0323 commented Oct 23, 2026

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

spartanz51 commented Jul 21, 2026 •

edited

Loading

buffett0323 commented Jul 23, 2026 •

edited

Loading