huggingface/accelerate

Pull Requests Commits

S1ro1 committed 1 year ago

50042518

Merge branch 'main' into feat/async-checkpointing

S1ro1 committed 1 year ago

571ca020

fix Muti node CUDA error: invalid device ordinal #3775 (#3779)

rdolmedo committed 1 year ago

Verified 0cb1a334

use reset_peak_memory_stats on xpu (#3772)

yao-matrix committed 1 year ago

Verified dfdc2190

fix FSDP2 test case failure on XPU (#3771)

yao-matrix committed 1 year ago

Verified 45959d7b

Fix: typo makes tests fail (#3765)

S1ro1 committed 1 year ago

Verified 8b493524

fix: torch_npu import error (#3764)

yanyongyu committed 1 year ago

Verified 9ead94e5

feat: allow mixed precision policy as dtype (#3751)

kmehant committed 1 year ago

Verified a0bc36e8

Fix typos (#3753)

cyyever committed 1 year ago

Verified 8830e58a

make torch_native_parallelism examples device agnostic (#3759)

yao-matrix committed 1 year ago

Verified 40ebb4be

fix: model.set_requires_gradient_sync(False) should be called to turn off gradient synchronization in FSDP2 (#3762)

EquationWalker committed 1 year ago

Verified ec92b1af

CP docs typos fixed (#3761)

sergiopaniego committed 1 year ago

Verified 62ede1ed

fix: specify device for process_tensor in example usage (#3755)

qgallouedec committed 1 year ago

Verified 9f9c490c

xpu INT64 all_gather issue fixed in 2.9 (#3756)

yao-matrix committed 1 year ago

Verified 8b55e62b

Add bf16/fp16 support for amp with mps device (#3373)

SunMarc committed 1 year ago

Verified 0e4419b3

Add support for TE MXFP8 recipe in accelerate (#3688)

pstjohn committed 1 year ago

Verified 3b67c216

[ND Parallel] Update examples, cleanup (#3737)

S1ro1 committed 1 year ago

Verified 7b981788

fix: specify device_ids in torch.distributed.barrier for PartialState (#3744)

qgallouedec committed 1 year ago

Verified c4460e33

Protect import for device_mesh (#3742)

SunMarc committed 1 year ago

Verified 5dd3d0b6

Feat: add to_json (#3743)

S1ro1 committed 1 year ago

Verified 5fe4460c

fix: cpu ram efficient loading for nd or hsdp parallelisms (#3740)

kmehant committed 1 year ago

Verified 979d81e4

Fix convert LayerNorm without bias to fp8 (#3725)

mjun0812 committed 1 year ago

Verified 7c25f696

feat: add ignored_params support for fsdp2 (#3731)

kmehant committed 1 year ago

Verified a7d6f28f

Fix tests (#3722)

SunMarc committed 1 year ago

Verified 23cf4ef8

bump to 1.11.0dev0

SunMarc committed 1 year ago

ff872f5f

SunMarc committed 1 year ago

Verified 2941a6b0

feature: CpuOffload pre_forward don't attempt to move if already on device (#3695)

JoeGaffney committed 1 year ago

Verified c0a3aefe

Remove `ParallelismConfig` from `PartialState` (#3720)

SunMarc committed 1 year ago

Verified 42fdda1c

TST Add test for FSDP ignored_modules as str (#3719)

BenjaminBossan committed 1 year ago

Verified e23b004b

Fix: tp size wouldn't read from env (#3716)

S1ro1 committed 1 year ago

Verified 898cad39

Older