huggingface/accelerate

Pull Requests Commits

S1ro1 committed 156 days ago

6c624c4a

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) (#3682)

salmanmohammadi committed 160 days ago

Verified 9359a019

set default submesh_tp_size to prevent unset local variable error (#3687)

winglian committed 169 days ago

Verified 2f075c72

bump to v1.10.0-release

SunMarc committed 174 days ago

7ecc2d7f

do not call partial state if not initialized

SunMarc committed 174 days ago

12f89bb7

Update Gaudi runner image to latest SynapseAI and enable previously disabled tests (#3653)

IlyasMoutawwakil committed 174 days ago

Verified 348aabaa

“Stop Halving My Batch!” · Default back-off 0.5 → 0.9 (#3684)

SunMarc committed 175 days ago

Verified 3b13453b

warn for invalid keys (#3613)

ved1beta committed 175 days ago

Verified 0408ab12

accelerate/data_loader.py: do not yield if the base_dataloader is empty (#3659)

0xnightwind committed 175 days ago

Verified 55e518a7

fix: wandb config not saved in offline mode (#3648)

ved1beta committed 175 days ago

Verified 7e11ac43

trackio (#3669)

pcuenca committed 175 days ago

Verified e2cc537d

Fix FP8 tests, enable FP8 to be used without direct `Accelerator()` configuring (#3677)

pstjohn committed 175 days ago

Verified 847ae58c

unpin datasets (#3681)

SunMarc committed 175 days ago

Verified 6e104f31

Speedup model loading by 4-5x in Diffusers ⚡ (#3674)

a-r-r-o-w committed 179 days ago

Verified 524e5f98

Bunch of FSDP improvements (#3671)

S1ro1 committed 181 days ago

Verified d6c986c3

xpu enablement on left cases (#3654)

yao-matrix committed 183 days ago

Verified 1ac8643d

Fix: properly error when DDP + Dtensor model (#3629)

S1ro1 committed 194 days ago

Verified 07ce7486

Added a check in the no_sync() function to avoid errors when using deepspeed zero2/3. (#3656)

xliu0105 committed 194 days ago

Verified 175fe915

Fix fsdp2 example (#3657)

shimizust committed 195 days ago

Verified fe16ce8b

Update gradient_accumulation.md (#3649)

kilavvy committed 198 days ago

Verified 5987d79a

SunMarc committed 201 days ago

Verified 31af8d4e

Add support for e5e2 and default to hybrid when launcher is used (#3640)

IlyasMoutawwakil committed 201 days ago

Verified b7493a82

bump to v1.9.0dev

SunMarc committed 201 days ago

a16d2bb3

fix grad acc deepspeed (#3638)

SunMarc committed 202 days ago

Verified cac22ed9

Fix: correct labels (#3637)

S1ro1 committed 202 days ago

Verified be826a6b

Feat: add cpu offload (#3636)

S1ro1 committed 202 days ago

Verified 59396408

[DeepSpeed] sync gradient accum steps from deepspeed plugin (#3632)

kashif committed 202 days ago

Verified 7f9c8cbe

feat: use datasets.IterableDataset shard if possible (#3635)

SunMarc committed 202 days ago

Verified 9888c7ed

Fix Typos in Documentation and Comments (#3621)

leopardracer committed 202 days ago

Verified 42a68c30

Integrate SwanLab for offline/online experiment tracking for Accelerate (#3605)

ShaohonChen committed 202 days ago

Verified 6597dae7

Older