huggingface/accelerate

Pull Requests Commits

S1ro1 committed 331 days ago

6c624c4a

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) (#3682)

salmanmohammadi committed 335 days ago

Verified 9359a019

set default submesh_tp_size to prevent unset local variable error (#3687)

winglian committed 343 days ago

Verified 2f075c72

bump to v1.10.0-release

SunMarc committed 349 days ago

7ecc2d7f

do not call partial state if not initialized

SunMarc committed 349 days ago

12f89bb7

Update Gaudi runner image to latest SynapseAI and enable previously disabled tests (#3653)

IlyasMoutawwakil committed 349 days ago

Verified 348aabaa

“Stop Halving My Batch!” · Default back-off 0.5 → 0.9 (#3684)

SunMarc committed 349 days ago

Verified 3b13453b

warn for invalid keys (#3613)

ved1beta committed 349 days ago

Verified 0408ab12

accelerate/data_loader.py: do not yield if the base_dataloader is empty (#3659)

0xnightwind committed 349 days ago

Verified 55e518a7

fix: wandb config not saved in offline mode (#3648)

ved1beta committed 350 days ago

Verified 7e11ac43

trackio (#3669)

pcuenca committed 350 days ago

Verified e2cc537d

Fix FP8 tests, enable FP8 to be used without direct `Accelerator()` configuring (#3677)

pstjohn committed 350 days ago

Verified 847ae58c

unpin datasets (#3681)

SunMarc committed 350 days ago

Verified 6e104f31

Speedup model loading by 4-5x in Diffusers ⚡ (#3674)

a-r-r-o-w committed 354 days ago

Verified 524e5f98

Bunch of FSDP improvements (#3671)

S1ro1 committed 356 days ago

Verified d6c986c3

xpu enablement on left cases (#3654)

yao-matrix committed 358 days ago

Verified 1ac8643d

Fix: properly error when DDP + Dtensor model (#3629)

S1ro1 committed 1 year ago

Verified 07ce7486

Added a check in the no_sync() function to avoid errors when using deepspeed zero2/3. (#3656)

xliu0105 committed 1 year ago

Verified 175fe915

Fix fsdp2 example (#3657)

shimizust committed 1 year ago

Verified fe16ce8b

Update gradient_accumulation.md (#3649)

kilavvy committed 1 year ago

Verified 5987d79a

SunMarc committed 1 year ago

Verified 31af8d4e

Add support for e5e2 and default to hybrid when launcher is used (#3640)

IlyasMoutawwakil committed 1 year ago

Verified b7493a82

bump to v1.9.0dev

SunMarc committed 1 year ago

a16d2bb3

fix grad acc deepspeed (#3638)

SunMarc committed 1 year ago

Verified cac22ed9

Fix: correct labels (#3637)

S1ro1 committed 1 year ago

Verified be826a6b

Feat: add cpu offload (#3636)

S1ro1 committed 1 year ago

Verified 59396408

[DeepSpeed] sync gradient accum steps from deepspeed plugin (#3632)

kashif committed 1 year ago

Verified 7f9c8cbe

feat: use datasets.IterableDataset shard if possible (#3635)

SunMarc committed 1 year ago

Verified 9888c7ed

Fix Typos in Documentation and Comments (#3621)

leopardracer committed 1 year ago

Verified 42a68c30

Integrate SwanLab for offline/online experiment tracking for Accelerate (#3605)

ShaohonChen committed 1 year ago

Verified 6597dae7

Older