huggingface/accelerate

Pull Requests Commits

Tmp: create device mesh beforehand

S1ro1 committed 1 year ago

67be9a69

Fix: correct launch command

S1ro1 committed 1 year ago

8df21cf5

S1ro1 committed 1 year ago

199cbedb

Feat: final benchmarks

S1ro1 committed 1 year ago

50f60e3c

S1ro1 committed 1 year ago

ed0fcace

Refactor: address comments

S1ro1 committed 1 year ago

7859437a

Feat: minor refactor + tests

S1ro1 committed 1 year ago

dc828eba

S1ro1 committed 1 year ago

8cef8d4d

Feat: some fixes

S1ro1 committed 1 year ago

7782a156

Feat: better tests

S1ro1 committed 1 year ago

0d20c3b1

Test: distributed dataloader

S1ro1 committed 1 year ago

ad7e1ad3

Fix: correct batch dispatch

S1ro1 committed 1 year ago

cc30dc60

Docs: start readme

S1ro1 committed 1 year ago

17cd32f6

Tests: some cp tests

S1ro1 committed 1 year ago

b39e39f0

S1ro1 committed 1 year ago

40999beb

S1ro1 committed 1 year ago

3670c6d2

Feat: add to toctree

S1ro1 committed 1 year ago

77bd1fab

Fix: add back commits lost in the rebase

S1ro1 committed 1 year ago

351d9890

Squashed commit of the following:

S1ro1 committed 1 year ago

27edf352

Docs: add concept guide

S1ro1 committed 1 year ago

f8bac5aa

Refactor: change fsdp2_fp8 example to use new utils

S1ro1 committed 1 year ago

deb42c10

Feat: add context-parallel example

S1ro1 committed 1 year ago

b816a676

Feat: add context-parallel to accelerator

S1ro1 committed 1 year ago

b1a48dc7

Bunch of FSDP improvements (#3671)

S1ro1 committed 1 year ago

Verified d6c986c3

xpu enablement on left cases (#3654)

yao-matrix committed 1 year ago

Verified 1ac8643d

Fix: properly error when DDP + Dtensor model (#3629)

S1ro1 committed 1 year ago

Verified 07ce7486

Added a check in the no_sync() function to avoid errors when using deepspeed zero2/3. (#3656)

xliu0105 committed 1 year ago

Verified 175fe915

Fix fsdp2 example (#3657)

shimizust committed 1 year ago

Verified fe16ce8b

Update gradient_accumulation.md (#3649)

kilavvy committed 1 year ago

Verified 5987d79a

SunMarc committed 1 year ago

Verified 31af8d4e

Older