huggingface/accelerate

Pull Requests Commits

[FSDP2] Auto-exclude non-floating frozen Params4bit from fully_shard to prevent QLoRA crash (#3987)

roycho96 committed 2 days ago

Verified 5adf855f

Add padded allgather and allreduce to reduce recompilation for Neuron devices. (#4000)

czkkkkkk committed 2 days ago

Verified 1bffb53d

fix: pass step parameter in TrackioTracker.log() (#3970)

liuyun7345 committed 3 days ago

Verified 94f975df

fix(FSDP2): auto-wrap policy ignoring _no_split_modules fallback (#3999)

JohnGiorgi committed 3 days ago

Verified b6f97773

Relax numerical tolerance for XPU in test_big_modeling (#4001)

YangKai0616 committed 3 days ago

Verified cff24503

pytorch-triton-xpu rename to triton-xpu (#4007)

sywangyi committed 3 days ago

Verified 072499ae

🔒 Pin GitHub Actions to commit SHAs (#3992)

paulinebm committed 4 days ago

Verified 01d097ae

fix: use key-based matching in fsdp2_load_full_state_dict (#3982)

roycho96 committed 20 days ago

Verified 0d8ca1a4

Fix TrackioTracker.log() ignoring step parameter (#3975)

joshuaswanson committed 23 days ago

Verified 1622df33

fix: add missing model_has_params4bit guard to fsdp2_load_full_state_dict call (#3981)

roycho96 committed 23 days ago

Verified 3936d308

Fix DistributedType documentation (#3980)

3manifold committed 23 days ago

Verified 71e8551f

Fix grammar, spelling, and consistency issues across docs and examples (#3961)

cihandemir committed 23 days ago

Verified 858ed553

Fix is_hf_initialized attribute (#3976)

SunMarc committed 26 days ago

Verified 13640d32

Torchao offload (#3973)

SunMarc committed 30 days ago

Verified 3475dcfa

fix: conditionally import torch.distributed.algorithms.join in accelerator (#3962)

0xDELUXA committed 32 days ago

Verified 9bbee85f

allow kernels flash-attn (#3959)

kashif committed 33 days ago

Verified f317f824

Fix iterable dataset sharding condition when n_shards == num_processes (#3958)

SunMarc committed 37 days ago

Verified 3e27a7c6

SunMarc committed 39 days ago

74427420

Fix testing ci (#3955)

SunMarc committed 39 days ago

Verified 2a7e27f7

Faster import (#3953)

SunMarc committed 39 days ago

Verified 0990ded5

fix-stateful-dataloader (#3952)

SunMarc committed 39 days ago

Verified 5cf9cf88

Prepare TP fix (#3945)

michaelbenayoun committed 40 days ago

Verified beed693e

Fix StatefulDataLoader KeyError with num_workers > 0 (#3931)

veeceey committed 41 days ago

Verified 8067abae

Fix FSDP2 crash with ignored_params on torch < 2.7.0 (#3924)

Mr-Neutr0n committed 41 days ago

Verified 8ec83c8a

Fix mutable default in Megatron init and IndexError on empty ModuleList (#3944)

jashshah999 committed 41 days ago

Verified 7554afbc

Fix logging logic when in_order is set to True (#3280)

yuxinyuan committed 41 days ago

Verified 23f2ab39

docs: update low-precision training docs to reflect MS-AMP deprecation (#3929)

ManasVardhan committed 41 days ago

Verified 58c3605f

fix: correct typo 'guarentee' to 'guarantee' (#3922)

thecaptain789 committed 41 days ago

Verified 2d2b440b

fixing ci (#3948)

SunMarc committed 44 days ago

Verified edd98518

lazy compile disable (#3947)

SunMarc committed 44 days ago

Verified 7ed69be0

Older