huggingface/accelerate

Pull Requests Commits

Feat: rename fsdp2 examples

S1ro1 committed 1 year ago

6918a5ab

Fix tests (#3722)

SunMarc committed 1 year ago

Verified 23cf4ef8

bump to 1.11.0dev0

SunMarc committed 1 year ago

ff872f5f

SunMarc committed 1 year ago

Verified 2941a6b0

feature: CpuOffload pre_forward don't attempt to move if already on device (#3695)

JoeGaffney committed 1 year ago

Verified c0a3aefe

Remove `ParallelismConfig` from `PartialState` (#3720)

SunMarc committed 1 year ago

Verified 42fdda1c

TST Add test for FSDP ignored_modules as str (#3719)

BenjaminBossan committed 1 year ago

Verified e23b004b

Fix: tp size wouldn't read from env (#3716)

S1ro1 committed 1 year ago

Verified 898cad39

Set parallelism_config in constructor due to Trainer reset of State (#3713)

winglian committed 1 year ago

Verified 24c8157b

Feat: context parallel v2.0 (#3700)

S1ro1 committed 1 year ago

Verified 6891c570

ENH: Allow FSDP ignored modules to be regex (#3698)

BenjaminBossan committed 1 year ago

Verified 24e48f3d

Fix: Ensure environment variable values are case-insensitive in Accelerate (#3712)

jp1924 committed 1 year ago

Verified 6640ff41

Fix: prepare works even if nothing except tp specified (rare) (#3707)

S1ro1 committed 1 year ago

Verified c173b4fd

Add Parallelism getter property to Accelerator class (#3703)

WoosungMyung committed 1 year ago

Verified cb343c63

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) (#3682)

salmanmohammadi committed 1 year ago

Verified 9359a019

set default submesh_tp_size to prevent unset local variable error (#3687)

winglian committed 1 year ago

Verified 2f075c72

bump to v1.10.0-release

SunMarc committed 1 year ago

7ecc2d7f

do not call partial state if not initialized

SunMarc committed 1 year ago

12f89bb7

Update Gaudi runner image to latest SynapseAI and enable previously disabled tests (#3653)

IlyasMoutawwakil committed 1 year ago

Verified 348aabaa

“Stop Halving My Batch!” · Default back-off 0.5 → 0.9 (#3684)

SunMarc committed 1 year ago

Verified 3b13453b

warn for invalid keys (#3613)

ved1beta committed 1 year ago

Verified 0408ab12

accelerate/data_loader.py: do not yield if the base_dataloader is empty (#3659)

0xnightwind committed 1 year ago

Verified 55e518a7

fix: wandb config not saved in offline mode (#3648)

ved1beta committed 1 year ago

Verified 7e11ac43

trackio (#3669)

pcuenca committed 1 year ago

Verified e2cc537d

Fix FP8 tests, enable FP8 to be used without direct `Accelerator()` configuring (#3677)

pstjohn committed 1 year ago

Verified 847ae58c

unpin datasets (#3681)

SunMarc committed 1 year ago

Verified 6e104f31

Speedup model loading by 4-5x in Diffusers ⚡ (#3674)

a-r-r-o-w committed 1 year ago

Verified 524e5f98

Bunch of FSDP improvements (#3671)

S1ro1 committed 1 year ago

Verified d6c986c3

xpu enablement on left cases (#3654)

yao-matrix committed 1 year ago

Verified 1ac8643d

Fix: properly error when DDP + Dtensor model (#3629)

S1ro1 committed 1 year ago

Verified 07ce7486

Older