huggingface/accelerate

Pull Requests Commits

feat: allow mixed precision policy as dtype (#3751)

kmehant committed 142 days ago

Verified a0bc36e8

Fix typos (#3753)

cyyever committed 143 days ago

Verified 8830e58a

make torch_native_parallelism examples device agnostic (#3759)

yao-matrix committed 143 days ago

Verified 40ebb4be

fix: model.set_requires_gradient_sync(False) should be called to turn off gradient synchronization in FSDP2 (#3762)

EquationWalker committed 144 days ago

Verified ec92b1af

CP docs typos fixed (#3761)

sergiopaniego committed 146 days ago

Verified 62ede1ed

fix: specify device for process_tensor in example usage (#3755)

qgallouedec committed 148 days ago

Verified 9f9c490c

xpu INT64 all_gather issue fixed in 2.9 (#3756)

yao-matrix committed 148 days ago

Verified 8b55e62b

Add bf16/fp16 support for amp with mps device (#3373)

SunMarc committed 154 days ago

Verified 0e4419b3

Add support for TE MXFP8 recipe in accelerate (#3688)

pstjohn committed 155 days ago

Verified 3b67c216

[ND Parallel] Update examples, cleanup (#3737)

S1ro1 committed 156 days ago

Verified 7b981788

fix: specify device_ids in torch.distributed.barrier for PartialState (#3744)

qgallouedec committed 156 days ago

Verified c4460e33

Protect import for device_mesh (#3742)

SunMarc committed 160 days ago

Verified 5dd3d0b6

Feat: add to_json (#3743)

S1ro1 committed 160 days ago

Verified 5fe4460c

fix: cpu ram efficient loading for nd or hsdp parallelisms (#3740)

kmehant committed 161 days ago

Verified 979d81e4

Fix convert LayerNorm without bias to fp8 (#3725)

mjun0812 committed 163 days ago

Verified 7c25f696

feat: add ignored_params support for fsdp2 (#3731)

kmehant committed 164 days ago

Verified a7d6f28f

Fix tests (#3722)

SunMarc committed 175 days ago

Verified 23cf4ef8

bump to 1.11.0dev0

SunMarc committed 175 days ago

ff872f5f

SunMarc committed 175 days ago

Verified 2941a6b0

feature: CpuOffload pre_forward don't attempt to move if already on device (#3695)

JoeGaffney committed 176 days ago

Verified c0a3aefe

Remove `ParallelismConfig` from `PartialState` (#3720)

SunMarc committed 176 days ago

Verified 42fdda1c

TST Add test for FSDP ignored_modules as str (#3719)

BenjaminBossan committed 176 days ago

Verified e23b004b

Fix: tp size wouldn't read from env (#3716)

S1ro1 committed 176 days ago

Verified 898cad39

Set parallelism_config in constructor due to Trainer reset of State (#3713)

winglian committed 176 days ago

Verified 24c8157b

Feat: context parallel v2.0 (#3700)

S1ro1 committed 177 days ago

Verified 6891c570

ENH: Allow FSDP ignored modules to be regex (#3698)

BenjaminBossan committed 177 days ago

Verified 24e48f3d

Fix: Ensure environment variable values are case-insensitive in Accelerate (#3712)

jp1924 committed 177 days ago

Verified 6640ff41

Fix: prepare works even if nothing except tp specified (rare) (#3707)

S1ro1 committed 177 days ago

Verified c173b4fd

Add Parallelism getter property to Accelerator class (#3703)

WoosungMyung committed 180 days ago

Verified cb343c63

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) (#3682)

salmanmohammadi committed 183 days ago

Verified 9359a019

Newer Older