huggingface/transformers

Pull Requests Commits

better distinguish masked/all-to-all path for nicer API

3outeille committed 3 days ago

b2b0d324

raise in `resolve_parallel_plans` when an override key matches no module / parameter / existing plan key

3outeille committed 3 days ago

2dc99524

add default all-to-all plan for qwen3_moe only + derive rule from plan and not from expert_dispatch property

3outeille committed 3 days ago

79fe4a43

Take TP and EP meshes in apply_tensor_parallelism

3outeille committed 4 days ago

e1d33d25

Clarify all-reduce and dispatch layouts in EP tests

3outeille committed 4 days ago

6d231256

Clarify TP and EP layouts in FSDP comparison test

3outeille committed 4 days ago

49f432cd

Always wrap dispatched experts on the expert FSDP mesh

3outeille committed 4 days ago

19118585

Clarify expert parallel docs and explicit sharding mesh selection

3outeille committed 4 days ago

8c2588da

Remove auto EP plans and clarify parallel plan tests

3outeille committed 4 days ago

251b2b94

3outeille committed 4 days ago

fc37645e

Simplify parallel plan resolution and clarify TP and EP meshes

3outeille committed 4 days ago

cc2237c5

Inline legacy expert parallel compatibility handling

3outeille committed 4 days ago

c8a05bc6

Merge branch 'ep-token-dispatch' into ep-mesh

3outeille committed 4 days ago

Verified 00717373

Merge branch 'main' into ep-token-dispatch

3outeille committed 4 days ago

Verified 56047f4c

Resolve TP and EP plans before sharding and derive expert dispatch

3outeille committed 4 days ago

6a1059ee

[docs] mrope and axial rope (#48717)

stevhliu committed 4 days ago

Verified 2cba1950

Fix `AutoModel.from_pretrained` not restoring `modules_to_save` weights (#48595)

shniubobo committed 4 days ago

Verified dbbd5512

Add integration tests for MuseGlimmerAssistantModel (#48796)

ydshieh committed 4 days ago

Verified 39f81b04

Simplify expert parallel configuration and explicit plan selection

3outeille committed 4 days ago

d4da6e0b

Fix kosmos flaky test (#48800)

IlyasMoutawwakil committed 4 days ago

Verified 229cd066

Restore legacy tensor-parallel initialization for compatibility (#48797)

3outeille committed 4 days ago

Verified a1ba1c14

Simplify MeshManager access and keep mesh views private

3outeille committed 5 days ago

4d63a32c

Encapsulate distributed mesh views behind named accessors

3outeille committed 5 days ago

0eb9ffa8

3outeille committed 5 days ago

b33e45e0

Unify dense and expert mesh construction

3outeille committed 5 days ago

ea65cfb3

[serge] Fix 12 integration tests for model `edgetam` failing with `import_or_config` (other (12)) (#48322)

sergereview[bot] committed 5 days ago

Verified d72aef09

Bump `peft` version requirement (#48716)

shniubobo committed 5 days ago

Verified 75c3583e

Merge origin/ep-mesh and restore expert-parallel mesh support

3outeille committed 5 days ago

6d8f54de

Merge branch 'ep-token-dispatch' into ep-mesh

3outeille committed 5 days ago

Verified b1fdbdf3

add kernel mapping entry for RMSNormGated, KDA, Conv1D on XPU (#48702)

kaixuanliu committed 5 days ago

Verified ca3bdf7a

Older