Repository navigation

[core] Shard tensor-parallel checkpoints on load and save - #14544

Merged

sayakpaul merged 38 commits into

huggingface:mainfrom

JingyaHuang:add-shard-ckpt-loading

Oct 1, 2026

Merged

[core] Shard tensor-parallel checkpoints on load and save#14544
sayakpaul merged 38 commits into
huggingface:mainfrom
JingyaHuang:add-shard-ckpt-loading

Commits on Aug 20, 2026
- [core] Shard tensor-parallel checkpoints on load and save
  JingyaHuang
  committed
  acdf4bf
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  0b9686b
Commits on Aug 21, 2026
- Raise when tensor parallelism is combined with quantization, offloading or LoRA
  JingyaHuang
  committed
  40ddb53
- Merge branch 'add-shard-ckpt-loading' of github.com:JingyaHuang/diffusers into add-shard-ckpt-loading
  JingyaHuang
  committed
  0760934
Commits on Aug 25, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  842c643
Commits on Aug 26, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  949cbdc
Commits on Aug 27, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  
  JingyaHuang
  and
  claude
  committed
  eb3f7f3
- Merge branch 'main' into add-shard-ckpt-loading
  
  JingyaHuang
  and
  claude
  committed
  a754bbe
Commits on Aug 28, 2026
- Merge branch 'add-shard-ckpt-loading' of github.com:JingyaHuang/diffusers into add-shard-ckpt-loading
  JingyaHuang
  committed
  6055292
Commits on Sep 2, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  sayakpaul
  authored
  fd31c34
Commits on Sep 10, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  9511143
Commits on Sep 19, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  53fd823
Commits on Sep 23, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  4112d18
- review: remove tp save/ dcp related
  JingyaHuang
  committed
  f741782
- review: add a new helper .
  JingyaHuang
  committed
  1b4d1d7
- review: moved the TP checks into enable_parallelism
  JingyaHuang
  committed
  4e9a927
Commits on Sep 24, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  0cca9a3
Commits on Sep 28, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  7ea8b97
- review: move the warning under caution block
  JingyaHuang
  committed
  a89e7e4
- review: add loading time numbers
  JingyaHuang
  committed
  e3fdafd
Commits on Sep 29, 2026
- review: move tp size dividende check
  JingyaHuang
  committed
  8a6ff80
- review: delete test
  JingyaHuang
  committed
  64c9e86
- review: consolidate tp checks
  JingyaHuang
  committed
  b52a272
- review: consolidate the tp checks, all in tensor_parallel.py
  JingyaHuang
  committed
  068d7ab
- review: improve conditionals
  JingyaHuang
  committed
  6a56929
- review: debug info
  JingyaHuang
  committed
  85dc21b
- review: check weights format before instantiating the model
  JingyaHuang
  committed
  aad9e9e
- review: restore duplicated _find_mismatched_keys since irrelevant
  JingyaHuang
  committed
  fc76c2c
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  cb01688
- revert: delete duplicated helper
  JingyaHuang
  committed
  30d4184
- review: remove the dead duplicate _find_mismatched_keys again
  JingyaHuang
  committed
  8f577c6
Commits on Sep 30, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  sayakpaul
  authored
  8b79c5b
- Merge branch 'main' into add-shard-ckpt-loading
  JingyaHuang
  authored
  2123a63
- review: update doc for loading benchmark of flux2-dev
  JingyaHuang
  committed
  55e6318
- review: improve the raising check
  JingyaHuang
  committed
  5eb09a4
- review: add an args section
  JingyaHuang
  committed
  b66b9c5
Commits on Oct 1, 2026
- Merge branch 'main' into add-shard-ckpt-loading
  sayakpaul
  authored
  68560c4
- Test tensor-parallel loading from sharded checkpoints
  sayakpaul
  committed
  95c44cc

Commits

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Commits on Aug 25, 2026

Commits on Aug 26, 2026

Commits on Aug 27, 2026

Commits on Aug 28, 2026

Commits on Sep 2, 2026

Commits on Sep 10, 2026

Commits on Sep 19, 2026

Commits on Sep 23, 2026

Commits on Sep 24, 2026

Commits on Sep 28, 2026

Commits on Sep 29, 2026

Commits on Sep 30, 2026

Commits on Oct 1, 2026