huggingface/transformers

Pull Requests Commits

Merge branch 'fsdp-core-model-loading' into refactor-tp-dtensor

3outeille committed 3 hours ago

eb428cc4

Merge branch 'fsdp-vs-ddp' into fsdp-core-model-loading

3outeille committed 3 hours ago

c5672400

Fix CI: remove stale type: ignore comments + ruff format

3outeille committed 3 hours ago

7f6cd3d8

Merge branch 'fsdp-vs-ddp' of https://github.com/huggingface/transformers into fsdp-vs-ddp

3outeille committed 3 hours ago

4eb5ca8b

Fix repository consistency: re-export moved FSDP utils + modular sync

3outeille committed 3 hours ago

0ff9ac05

Run `make style` to fix ruff linting issues

3outeille committed 4 hours ago

f2dfe9f3

Merge branch 'distributed_api' into fsdp-vs-ddp

3outeille committed 5 hours ago

5e017cf5

unify the utils for fsdp

3outeille committed 20 hours ago

6f9e2b67

Remove train_fsdp_tp_torchtitan_style.py

3outeille committed 21 hours ago

34db8405

Merge branch 'distributed_api' of https://github.com/huggingface/transformers into distributed_api

3outeille committed 21 hours ago

e7832312

Add distributed training scripts

3outeille committed 21 hours ago

c33873e7

Merge branch 'fsdp-vs-ddp' of https://github.com/huggingface/transformers into fsdp-vs-ddp

3outeille committed 22 hours ago

23a2c059

revert some files

3outeille committed 22 hours ago

abfd57ee

Merge branch 'distributed_api' into fsdp-vs-ddp

3outeille committed 22 hours ago

Verified 90384750

Merge branch 'main' into distributed_api

3outeille committed 22 hours ago

Verified eeefc9e8

TPStyle API + dense model tensor parallelism

3outeille committed 23 hours ago

11b55a20

Fix #45305 + add regression test GAS (#45349)

florian6973 committed 23 hours ago

Verified 20b6f538

DistributedConfig + shard-on-read loading

3outeille committed 23 hours ago

739332cd

FSDP2 (fully_shard) integration

3outeille committed 23 hours ago

a5c25548

Update `trackio` integration to use Buckets and "freeze" Space after training (#45329)

abidlabs committed 23 hours ago

Verified 7afee868

Merge remote-tracking branch 'origin/main' into distributed_api

3outeille committed 23 hours ago

45a01a54

fix(qwen3_moe): correct return type annotation on Qwen3MoeSparseMoeBlock.forward (#45352)

RudrenduPaul committed 23 hours ago

Verified 357f414c

Fix: NotebookProgressCallback crash when evaluating with the Trainer (#44949)

Charly21r committed 23 hours ago

Verified 0b5dbfc9

Merge branch 'main' into distributed_api

3outeille committed 23 hours ago

Verified b7ec958e

docs: fix 5 docstring errors in Gemma3nTextConfig (typos, grammar, formatting) (#45370)

RudrenduPaul committed 1 day ago

Verified 6db69b91

Less unnecessary RoPE warnings (#45289)

zucchini-nlp committed 1 day ago

Verified 19a7c100

[`Tokenizers`] Move gpt sw3 tokenizer out (#45404)

vasqu committed 1 day ago

Verified 2c498dfd

Fix unintended Hub metadata calls from _patch_mistral_regex (#43603)

vaibhav-research committed 1 day ago

Verified def8e6a2

Fix MoE routers returning probabilities instead of logits (#45131)

yacinemebarki committed 1 day ago

Verified d2941693

Fix NaN weights on non-rank-0 FSDP processes (#45050)

albertvillanova committed 1 day ago

Verified ff49f7c4

Older