microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jeffra/zero-1-fix-test

jeffra committed 4 years ago

Verified bebc5eb7

fix padding logic to align with world size

jeffra committed 4 years ago

19fa14fa

more fine-grained manifest file for includes/excludes (#540)

jeffra committed 4 years ago

Verified fdd81c30

append job-name if explicit output dir is given (#539)

jeffra committed 4 years ago

Verified 5b09be60

add dp size to padding to ensure we have enough to split across ranks

jeffra committed 4 years ago

1702415d

Fix layout bug in ZeRO Stage 1 checkpoint logic (#531)

tjruwase committed 4 years ago

Verified 7752dc5e

jeffra committed 4 years ago

94c0c588

map max elems per comm into checkpoints

jeffra committed 4 years ago

c91dae82

formatting and less aggressive assert

jeffra committed 4 years ago

5a401871

fix testing backing to work with torch1.7, fix div by 0

jeffra committed 4 years ago

519ea19f

pick best max elems per comm to reduce extra padding

jeffra committed 4 years ago

c35f2371

fix for empty partitions

jeffra committed 4 years ago

cc59e10d

jeffra committed 4 years ago

c990b871

jeffra committed 4 years ago

bc8a2e0c

jeffra committed 4 years ago

5edf3ed1

init self.local_sub_partitions

jeffra committed 4 years ago

45b7afae

clean-up and added previously missing reduction options

jeffra committed 4 years ago

f39335c8

zero-1 memory fix

jeffra committed 4 years ago

8fc88cce

jeffra committed 4 years ago

9941ce75

Dependency pruning (#528)

jeffra committed 4 years ago

Verified 0dc84200

Installation documentation updates. (#525)

Shaden Smith committed 4 years ago

Verified d779bd53

ds_report bug fix on cpu and guard torch import in setup.py (#524)

jeffra committed 4 years ago

Verified ca9ab120

DeepSpeed JIT op + PyPI support (#496)

jeffra committed 4 years ago

Verified 31f46fee

Update zero.md tutorial (#495)

samyam committed 4 years ago

Verified 0ad4fd88

fix bug on non-DLTS infra when no output path set (#523)

jeffra committed 4 years ago

Verified eea1c285

PLD release (#513)

tjruwase committed 4 years ago

Verified be1147c0

updating pld docs (#517)

minjiaz committed 4 years ago

Verified e082d475

Fix PLD news url (#515)

tjruwase committed 4 years ago

Verified 41fb24b3

PLD documentation (#514)

tjruwase committed 4 years ago

Verified e351090c

Fixing CPU-Adam convergence issue (#503)

RezaYazdaniAminabadi committed 4 years ago

Verified 7d4d742b

Older