huggingface/transformers

Pull Requests Commits

Merge branch 'main' into fix-moe-skip-reason

tarekziade committed 12 days ago

Verified 6e31d9a5

🚨 TP: give embeddings their own style, shard input embeddings by default, and shard widths that don't divide by the TP size (#49570)

IlyasMoutawwakil committed 12 days ago

Verified 718d12a9

Document how to avoid the Metaspace prefix after added tokens (#45822)

qflen committed 12 days ago

Verified 54c0fe02

Load tokenizer.json once in TokenizersBackend (2-2.9x faster AutoTokenizer.from_pretrained) (#49667)

deadstrobe5 committed 12 days ago

Verified 49db7636

Ernie4.5-VL-MoE: shard the text and vision experts under TP and EP (#49462)

IlyasMoutawwakil committed 12 days ago

Verified 9e6fdd6b

Declare the input modalities of the VLMs that report text only (#49677)

qgallouedec committed 12 days ago

Verified 4c414256

Fix zero expert gradients in bfloat16 with expert parallelism and ep_size < fsdp_size (#49688)

qgallouedec committed 12 days ago

Verified d8894645

Skip Muse TP (#49717)

remi-or committed 12 days ago

Verified bf423154

Fix test selection for virtual module imports (#49690)

tarekziade committed 14 days ago

Verified d4804f9d

🚨 MoE: shard the experts in every TP/EP plan, and test for it (#49206)

IlyasMoutawwakil committed 14 days ago

Verified 8498ed42

[docs] add Google TPU hardware guide (#49642)

tengomucho committed 14 days ago

Verified 551122ae

Copy default response parser args (#49370)

Rocketknight1 committed 14 days ago

Verified 09281b8d

Serve legacy module aliases through a sys.meta_path finder (#48992)

Rocketknight1 committed 14 days ago

Verified 23292ca5

Fix small bug in auto mappings (#49664)

yonigozlan committed 14 days ago

Verified 966f59c8

Make `DtensorShardOperation` work on torch 2.6 and 2.7 (#49657)

hazelxue committed 14 days ago

Verified 7bf3c5ec

Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing (#49652)

naveecode committed 14 days ago

Verified f74cb53b

Fix DeepGEMM Mega MoE under expert parallelism (#49428)

IlyasMoutawwakil committed 14 days ago

Verified eb943c26

Fix HunYuan-VL image assignment during batched generation (#49557)

Arnav66692 committed 14 days ago

Verified 742d8474

Fix flaky Evolla tests producing NaN outputs (#49660)

tarekziade committed 15 days ago

Verified a8262af9

Quantization cleanpup (#49548)

ArthurZucker committed 15 days ago

Verified b7c41684

[rocm] Add ROCm expectations to Kolibri-1 logits test (#49661)

ericschreiber committed 15 days ago

Verified e5c1aaee

[CB] Various small fixes for MPS (#49654)

remi-or committed 15 days ago

Verified 364abe43

Aligns test expectations with the accelerator path under test: (#49653)

sywangyi committed 15 days ago

Verified 9fb4b5a9

[docs] Processor config (#49643)

stevhliu committed 15 days ago

Verified 683b7219

post release stuff (#49646)

vasqu committed 15 days ago

Verified b0cdc61e

Add Muse Spark Open (#49644)

guarin committed 15 days ago

Verified 487dcfa6

[docs] Hardware docs template (#49575)

stevhliu committed 15 days ago

Verified d2e102b6

Add MOSS-Transcribe-Diarize model (#48386)

itazap committed 15 days ago

Verified 9d59c2c5

Integrate the UltraBERT architecture (#49596)

tomaarsen committed 15 days ago

Verified 4c6f2559

Add MIC contract lock files for PR CI integration (#49631)

ydshieh committed 15 days ago

Verified b0eff172

Older