huggingface/accelerate

Pull Requests Commits

Merge updated examples

S1ro1 committed 1 year ago

a3f8d234

S1ro1 committed 1 year ago

8ecadce1

Feat: first version

S1ro1 committed 1 year ago

91985ab9

fix: cpu ram efficient loading for nd or hsdp parallelisms (#3740)

kmehant committed 1 year ago

Verified 979d81e4

Fix convert LayerNorm without bias to fp8 (#3725)

mjun0812 committed 1 year ago

Verified 7c25f696

feat: add ignored_params support for fsdp2 (#3731)

kmehant committed 1 year ago

Verified a7d6f28f

Fix tests (#3722)

SunMarc committed 1 year ago

Verified 23cf4ef8

bump to 1.11.0dev0

SunMarc committed 1 year ago

ff872f5f

SunMarc committed 1 year ago

Verified 2941a6b0

feature: CpuOffload pre_forward don't attempt to move if already on device (#3695)

JoeGaffney committed 1 year ago

Verified c0a3aefe

Remove `ParallelismConfig` from `PartialState` (#3720)

SunMarc committed 1 year ago

Verified 42fdda1c

TST Add test for FSDP ignored_modules as str (#3719)

BenjaminBossan committed 1 year ago

Verified e23b004b

Fix: tp size wouldn't read from env (#3716)

S1ro1 committed 1 year ago

Verified 898cad39

Set parallelism_config in constructor due to Trainer reset of State (#3713)

winglian committed 1 year ago

Verified 24c8157b

Feat: context parallel v2.0 (#3700)

S1ro1 committed 1 year ago

Verified 6891c570

ENH: Allow FSDP ignored modules to be regex (#3698)

BenjaminBossan committed 1 year ago

Verified 24e48f3d

Fix: Ensure environment variable values are case-insensitive in Accelerate (#3712)

jp1924 committed 1 year ago

Verified 6640ff41

Fix: prepare works even if nothing except tp specified (rare) (#3707)

S1ro1 committed 1 year ago

Verified c173b4fd

Add Parallelism getter property to Accelerator class (#3703)

WoosungMyung committed 1 year ago

Verified cb343c63

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) (#3682)

salmanmohammadi committed 1 year ago

Verified 9359a019

set default submesh_tp_size to prevent unset local variable error (#3687)

winglian committed 1 year ago

Verified 2f075c72

bump to v1.10.0-release

SunMarc committed 1 year ago

7ecc2d7f

do not call partial state if not initialized

SunMarc committed 1 year ago

12f89bb7

Update Gaudi runner image to latest SynapseAI and enable previously disabled tests (#3653)

IlyasMoutawwakil committed 1 year ago

Verified 348aabaa

“Stop Halving My Batch!” · Default back-off 0.5 → 0.9 (#3684)

SunMarc committed 1 year ago

Verified 3b13453b

warn for invalid keys (#3613)

ved1beta committed 1 year ago

Verified 0408ab12

accelerate/data_loader.py: do not yield if the base_dataloader is empty (#3659)

0xnightwind committed 1 year ago

Verified 55e518a7

fix: wandb config not saved in offline mode (#3648)

ved1beta committed 1 year ago

Verified 7e11ac43

trackio (#3669)

pcuenca committed 1 year ago

Verified e2cc537d

Fix FP8 tests, enable FP8 to be used without direct `Accelerator()` configuring (#3677)

pstjohn committed 1 year ago

Verified 847ae58c

Older