huggingface/accelerate

Pull Requests Commits

Feat: parallelism config + cp works

S1ro1 committed 191 days ago

90f3e180

Tmp: create device mesh beforehand

S1ro1 committed 191 days ago

131ebe35

Fix: correct launch command

S1ro1 committed 191 days ago

230b433e

S1ro1 committed 191 days ago

0d14b80a

Feat: final benchmarks

S1ro1 committed 191 days ago

518da359

S1ro1 committed 191 days ago

47e4a991

Refactor: address comments

S1ro1 committed 191 days ago

af69060b

Feat: minor refactor + tests

S1ro1 committed 191 days ago

402d158c

S1ro1 committed 191 days ago

f434a6cc

Feat: some fixes

S1ro1 committed 191 days ago

b5aa5a74

Feat: better tests

S1ro1 committed 191 days ago

4e5c5ba5

Test: distributed dataloader

S1ro1 committed 191 days ago

0a132d5f

Fix: correct batch dispatch

S1ro1 committed 191 days ago

714eff9f

Docs: start readme

S1ro1 committed 191 days ago

92ee7c50

Tests: some cp tests

S1ro1 committed 191 days ago

929511cd

S1ro1 committed 191 days ago

22eec22f

S1ro1 committed 191 days ago

dbe0d82b

Feat: add to toctree

S1ro1 committed 191 days ago

1bec0487

Fix: add back commits lost in the rebase

S1ro1 committed 191 days ago

95b69a93

Squashed commit of the following:

S1ro1 committed 191 days ago

e590ad00

Docs: add concept guide

S1ro1 committed 191 days ago

cc36c966

Refactor: change fsdp2_fp8 example to use new utils

S1ro1 committed 191 days ago

db5800a5

Feat: add context-parallel example

S1ro1 committed 191 days ago

59163b26

Feat: add context-parallel to accelerator

S1ro1 committed 191 days ago

16ff5185

Bunch of FSDP improvements (#3671)

S1ro1 committed 191 days ago

ae93550e

xpu enablement on left cases (#3654)

yao-matrix committed 191 days ago

50140346

Fix: properly error when DDP + Dtensor model (#3629)

S1ro1 committed 191 days ago

b899116c

Added a check in the no_sync() function to avoid errors when using deepspeed zero2/3. (#3656)

xliu0105 committed 191 days ago

a0e02b1c

Fix fsdp2 example (#3657)

shimizust committed 191 days ago

1102ce80

S1ro1 committed 193 days ago

cd31b02b

Older