huggingface/transformers

Pull Requests Commits

Pick the expert-parallel strategy from `DistributedConfig.ep_strategy`

IlyasMoutawwakil committed 16 hours ago

f2e79153

Leave experts that route themselves to the router-masked plan

IlyasMoutawwakil committed 18 hours ago

2e30d871

Masked EP as its own parallel style, resolved from `ep_dispatch_experts` when `ep_size == tp_size`

IlyasMoutawwakil committed 21 hours ago

89c57aff

Import the distributed test helper relatively, as the other distributed tests do

IlyasMoutawwakil committed 22 hours ago

cbcff744

Test the masked path on two real ranks, at the end of the layer tests

IlyasMoutawwakil committed 22 hours ago

0735ccac

Expert-parallel dispatch runs the experts masked when the EP group shares one batch

IlyasMoutawwakil committed 22 hours ago

d6f4bf1f

:rotating_light: SubConfigSpec for centralized init of subconfigs (#48282)

zucchini-nlp committed 22 hours ago

Verified d4f69a86

PR CI: grant actions: read to the reusable workflow (#49417)

tarekziade committed 23 hours ago

Verified 125f265a

[Bugfix] [Modeling] Fix DSV4 norm (#47486)

kylesayrs committed 1 day ago

Verified fa406191

Do not wrap the model in FSDP for expert-parallel token dispatch (#49383)

3outeille committed 1 day ago

Verified cb33194a

[docs] Update Spaces (#49242)

stevhliu committed 1 day ago

Verified a96730c8

handle empty precompiled charsmap in spm converter (#49211)

itazap committed 1 day ago

Verified 91ea1192

🚨🚨🚨 luke fixe (#48408)

itazap committed 1 day ago

Verified 2b727b6d

[CI] Temporarily disable AMD scheduled CI trigger (#49394)

ydshieh committed 1 day ago

Verified 7b822d20

[tests] Fix flaky CMVN tests in Speech2TextFeatureExtractionWithoutTorchaudioTest (#49374)

ydshieh committed 1 day ago

Verified 705a7cf8

Fix Phi3 LongRoPE cache rebuild at the context boundary (#49361)

LE0-Lin committed 1 day ago

Verified 6a33cb58

[Docker] Upgrade to torch 2.14/CUDA 13.0 and optimize FA2 build from source (#49381)

ydshieh committed 1 day ago

Verified 6d3802a4

Fix Pixtral Flash Attention image boundaries after axial RoPE refactor (#49373)

oliverholworthy committed 1 day ago

Verified ff704ffd

Let token dispatch run with `ep_size != tp_size` (#49368)

qgallouedec committed 2 days ago

Verified e598fbad

[tests] Skip onnx.exactness for BitForImageClassification (ORT fp32 drift) (#49366)

ydshieh committed 2 days ago

Verified 14e738b5

Link the padding side section from SSM and hybrid model docs (#49247)

jayzuccarelli committed 2 days ago

Verified cbde22f4

Smthn smthn (#49364)

vasqu committed 2 days ago

Verified 92cd495f

Revert "[CI] Temporarily disable AMD scheduled CI trigger" (#49271) (#49362)

ydshieh committed 2 days ago

Verified a7e8ff2b

ALM testx fIxing... (#49355)

zucchini-nlp committed 2 days ago

Verified 571c5cc7

Fix DataCollatorForLanguageModeling ignoring seed=0 (#49349)

akanyaani committed 2 days ago

Verified b4526a76

Fix explicit kernelization modes for evaluation models (#49339)

DimensionSTP committed 2 days ago

Verified 5a27d2d2

fix(cohere_compass): add video to input_modalities (#49320) (#49323)

destopianpirate committed 2 days ago

Verified 23c21ac8

GPT-OSS: read the clamped SwiGLU's alpha and limit from the config (#49346)

IlyasMoutawwakil committed 2 days ago

Verified f1d0d9fb

[`distributed`] Default MoE `ep_plans` to token dispatch (#49160)

3outeille committed 2 days ago

Verified 9921402b

[`distributed`]: adapt Trainer to work Expert Parallel (#48873)

3outeille committed 2 days ago

Verified 8625785e

Older