microsoft/DeepSpeed

Pull Requests Commits

fixing som issue for encoder-decoder inference

Reza Yazdani committed 2 years ago

497792ed

add some minor changes

Reza Yazdani committed 3 years ago

94515902

add the decoder transformer-api

Reza Yazdani committed 3 years ago

df33a000

adding support for encoder-decoder kernel-injection with tensor parallelism

Reza Yazdani committed 3 years ago

7ac4ab74

Merge branch 'master' of github.com:microsoft/DeepSpeed

Reza Yazdani committed 3 years ago

dfb603fe

Fix OneCycleLR zero division error (#1498)

AnesBenmerzoug committed 3 years ago

Verified db5d8ba2

Fix typo (#1501)

manuelciosici committed 3 years ago

Verified e976accb

enable/disable moe token dropping. (#1492)

awan-10 committed 3 years ago

Verified 56635d5b

Synchronize folder creation; Single latest file writer (#1486)

tjruwase committed 3 years ago

Verified 99bd592d

fixing the softmax masking when using triangular masking

Reza Yazdani committed 3 years ago

f7ef4b5e

fix read-the-docs based on this issue: https://github.com/sphinx-doc/sphinx/issues/9727 (#1489)

jeffra committed 3 years ago

Verified 24dd285f

Proposal of how we might use sparse tensors for gradients (#1484)

Dipet committed 3 years ago

Verified fcb3ca5e

Add cpu adagrad (#1358)

fumihwh committed 3 years ago

Verified 8abdaee2

add moe+zero ckpt unit test. (#1429)

awan-10 committed 3 years ago

Verified 0b77d1d9

conglongli committed 3 years ago

Verified 29bee73f

fix pipeline engine (#1473)

conglongli committed 3 years ago

Verified 17a479dd

Ensure single zero3 context (#1462)

tjruwase committed 3 years ago

Verified 58a8e13c

Switch to use or not einsum op. Needed for ORT (#1456)

ganik committed 3 years ago

Verified 20bf1cc1

fix typos and add improvements (#1463)

stas00 committed 3 years ago

Verified dd224284

document about engine.load_checkpoint() (#1457)

skpig committed 3 years ago

Verified b4e5826a

Add basic MoE timing breakdown (#1428)

awan-10 committed 3 years ago

Verified 1fc74cb9

Fix docstrings for lr_schedules.py (#1455)

junxu committed 3 years ago

Verified c64a03db

fix sparse_attention imports (#1446)

olegklimov committed 3 years ago

Verified 80e263c5

webpage link edit (#1450)

Shaden Smith committed 3 years ago

Verified f88b0e5f

doc update (#1448)

jeffra committed 3 years ago

Verified 4e736237

[docs] 530b update (#1447)

jeffra committed 3 years ago

Verified 57a99542

fix cl for pp support (#1443)

conglongli committed 3 years ago

Verified cd7967d6

CL for big science (#1440)

conglongli committed 3 years ago

Verified fbea7b49

Big science fix passing multiple tensors (#1400)

thomasw21 committed 3 years ago

Verified 9c672783

Fix typo (ValueError) (#1434)

rpengms committed 3 years ago

Verified d8e9ef6f

Older