huggingface/transformers

Pull Requests Commits

Parametrize the dispatch tests by strategy name; docs say ep == tp is the current constraint

3outeille committed 26 days ago

e4e43442

EpDispatchExpertsParallel is its own style; name the expert-gradient scaling

3outeille committed 26 days ago

9c5609d9

Put the per-mesh optimizer and gradient-norm helpers next to each other

3outeille committed 26 days ago

f8a3a9ce

Test the Trainer under token dispatch against the Trainer under DDP

3outeille committed 26 days ago

2dd426ee

Trainer: name the ranks that share a batch instead of misreporting the TP size

3outeille committed 26 days ago

cb37ef6c

Trainer reads the load-time DistributedConfig instead of mirrored model attributes

3outeille committed 26 days ago

caed4a7a

Find the expert modules by the marker the sharding style sets

3outeille committed 26 days ago

f0d3a726

Derive the token dispatch plan in tensor_parallel, not in the model mixin

3outeille committed 26 days ago

1dc0aee5

One predicate for FSDP2-managed models

3outeille committed 26 days ago

cfa60c41

Name the tensor parallel mesh dimension and slice meshes by name

3outeille committed 26 days ago

dec05198

Merge branch 'fsdp2-ep-2d-mesh' into ep-token-dispatch

qgallouedec committed 27 days ago

Verified b56e1d68

Merge branch 'main' into fsdp2-ep-2d-mesh

qgallouedec committed 27 days ago

Verified a6f5824a

[serge] Fix 2 integration tests for model `minimax` failing with `output_mismatch` (tensor values differ (2)) (#48515)

sergereview[bot] committed 27 days ago

Verified ff4bb5ee

Merge remote-tracking branch 'upstream/fsdp2-ep-2d-mesh' into ep-token-dispatch

qgallouedec committed 27 days ago

db788602

Merge branch 'main' into fsdp2-ep-2d-mesh

qgallouedec committed 27 days ago

Verified 1be3a7f5

[Fix] yolos offload issue (#48688)

molbap committed 27 days ago

Verified 9d13f8cf

Skip the expert-parallel sentinel masking when expert parallelism is off (#48201)

qgallouedec committed 27 days ago

Verified 606e6e8b

Name the dispatch strategy instead of switching it with a bool

qgallouedec committed 27 days ago

a6e36c09

Declare dispatch_experts_forward next to its only caller

qgallouedec committed 27 days ago

28cb4827

Synthetic test assets (#48589)

tarekziade committed 27 days ago

Verified c6947074

Fix deepspeed ci (#48640)

SunMarc committed 27 days ago

Verified 29723434

[MusicgenMelody] Fix conditioning silently dropped at generation step 0 (#48679)

ydshieh committed 27 days ago

Verified 5bed6296

[`MoE`] Fix eager EP (#48653)

vasqu committed 27 days ago

Verified 93ebf6b1

[higgs_audio_v2] Fix: use config.num_codebooks in audio labels tensor (Simple Fix!) (#48560)

b-re-w committed 27 days ago

Verified 455bcd0a

Assert cached decode matches recomputing without a cache (#48289)

IlyasMoutawwakil committed 27 days ago

Verified fd798ba1

Fix `AutoImageProcessor` requiring torchvision when only Pillow is installed (#48616)

blipbyte committed 27 days ago

Verified 1ee31851

Mirror the registered pytree flatten when building automatic dynamic shapes (#48578)

IlyasMoutawwakil committed 27 days ago

Verified c583a3a1

Register activation kernel layers on XPU (#47858)

jiqing-feng committed 27 days ago

Verified cb541c21

[GLM 5.3 Flash] Preserve original names when saving text checkpoints (#48676)

Dovis01 committed 27 days ago

Verified e71d8c53

Merge branch 'fsdp2-ep-2d-mesh' into ep-token-dispatch

qgallouedec committed 27 days ago

Verified 4ce47004

Older