huggingface/accelerate

Pull Requests Commits

Feat: initial impl

S1ro1 committed 118 days ago

b260de26

Added Tip for better rendering (#3781)

sergiopaniego committed 119 days ago

Verified e79f3836

fix Muti node CUDA error: invalid device ordinal #3775 (#3779)

RicardoDominguez committed 121 days ago

Verified 0cb1a334

use reset_peak_memory_stats on xpu (#3772)

yao-matrix committed 122 days ago

Verified dfdc2190

fix FSDP2 test case failure on XPU (#3771)

yao-matrix committed 122 days ago

Verified 45959d7b

Fix: typo makes tests fail (#3765)

S1ro1 committed 125 days ago

Verified 8b493524

fix: torch_npu import error (#3764)

yanyongyu committed 125 days ago

Verified 9ead94e5

feat: allow mixed precision policy as dtype (#3751)

kmehant committed 126 days ago

Verified a0bc36e8

Fix typos (#3753)

cyyever committed 126 days ago

Verified 8830e58a

make torch_native_parallelism examples device agnostic (#3759)

yao-matrix committed 126 days ago

Verified 40ebb4be

fix: model.set_requires_gradient_sync(False) should be called to turn off gradient synchronization in FSDP2 (#3762)

EquationWalker committed 128 days ago

Verified ec92b1af

CP docs typos fixed (#3761)

sergiopaniego committed 129 days ago

Verified 62ede1ed

fix: specify device for process_tensor in example usage (#3755)

qgallouedec committed 131 days ago

Verified 9f9c490c

xpu INT64 all_gather issue fixed in 2.9 (#3756)

yao-matrix committed 131 days ago

Verified 8b55e62b

Add bf16/fp16 support for amp with mps device (#3373)

SunMarc committed 137 days ago

Verified 0e4419b3

Add support for TE MXFP8 recipe in accelerate (#3688)

pstjohn committed 138 days ago

Verified 3b67c216

[ND Parallel] Update examples, cleanup (#3737)

S1ro1 committed 139 days ago

Verified 7b981788

fix: specify device_ids in torch.distributed.barrier for PartialState (#3744)

qgallouedec committed 139 days ago

Verified c4460e33

Protect import for device_mesh (#3742)

SunMarc committed 143 days ago

Verified 5dd3d0b6

Feat: add to_json (#3743)

S1ro1 committed 143 days ago

Verified 5fe4460c

fix: cpu ram efficient loading for nd or hsdp parallelisms (#3740)

kmehant committed 144 days ago

Verified 979d81e4

Fix convert LayerNorm without bias to fp8 (#3725)

mjun0812 committed 147 days ago

Verified 7c25f696

feat: add ignored_params support for fsdp2 (#3731)

kmehant committed 147 days ago

Verified a7d6f28f

Fix tests (#3722)

SunMarc committed 158 days ago

Verified 23cf4ef8

bump to 1.11.0dev0

SunMarc committed 158 days ago

ff872f5f

SunMarc committed 158 days ago

Verified 2941a6b0

feature: CpuOffload pre_forward don't attempt to move if already on device (#3695)

JoeGaffney committed 159 days ago

Verified c0a3aefe

Remove `ParallelismConfig` from `PartialState` (#3720)

SunMarc committed 159 days ago

Verified 42fdda1c

TST Add test for FSDP ignored_modules as str (#3719)

BenjaminBossan committed 159 days ago

Verified e23b004b

Fix: tp size wouldn't read from env (#3716)

S1ro1 committed 159 days ago

Verified 898cad39

Older