Add Cosmos3 action generation support#13823

Open

yzhautouskay wants to merge 15 commits into

huggingface:mainfrom

yzhautouskay:cosmos3/action-generation

Contributor

yzhautouskay commented May 28, 2026

What does this PR do?

Fixes # (issue)

Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
Did you read the contributor guideline?
Did you read our philosophy doc (important for complex PRs)?
Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.


          Add Cosmos3 action generation support

a8296fb

github-actions Bot added size/L models pipelines examples and removed size/L labels


          Add README action examples

2fcef5b

github-actions Bot added the size/L label

yzhautouskay added 3 commits

May 28, 2026 11:59


          Use do_classifier_free_guidance property

40ea973


          Remove unused method

591cd4d


          Add action policy example to pipelines doc

04efd90

github-actions Bot added the documentation label


          Adding model selection for action example doc.

362b6eb

atharvajoshi10 mentioned this pull request

Adding Cosmos 3 to Diffusers #13818

Merged

dg845 reviewed

View reviewed changes

src/diffusers/models/transformers/transformer_cosmos3.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/models/transformers/transformer_cosmos3.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

src/diffusers/pipelines/cosmos/pipeline_cosmos3_omni.py Outdated

dg845 reviewed

View reviewed changes

Collaborator

dg845 left a comment

Thanks for the PR! Left some initial comments :).

yzhautouskay added 5 commits

May 29, 2026 12:29


          Remove redundant casts

5ff2ea9


          Rename _pack_action_tokens to _prepare_action_segment

a01c1c9


          Move validation checks to check_inputs

c12e6b1


          Add action arguments in the __call__ docstring

fbcd077


          Move action mode check to check_inputs

7c4e2f4

yzhautouskay added 4 commits

May 29, 2026 12:42


          Rename action to action_tokens

57d3d07


          Add warning for num_frames ovewrite attempt

a6e2040


          Rename action_tokens to raw_actions

913c24f


          Remove scheduler config override

3bce946

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation examples models pipelines size/L