microsoft/DeepSpeed

Pull Requests Commits

jeffra committed 4 years ago

36126122

Merge pull request #19 from ROCmSoftwarePlatform/IFU-master-2021-06-07

jithunnair-amd committed 4 years ago

Verified d98da5c6

Revert "Merge pull request #21 from rraminen/PR_Revert_HIP_Cooperative_Groups_Workaround"

jithunnair-amd committed 4 years ago

5b0fac74

Merge pull request #21 from rraminen/PR_Revert_HIP_Cooperative_Groups_Workaround

jithunnair-amd committed 4 years ago

Verified bf2979b5

hip cooperative groups functionality for coalesced_group in fused_lamb_cuda_kernel.cu is not implemented yet

rraminen committed 4 years ago

81b744ef

clean up logging (#1190)

stas00 committed 4 years ago

Verified a0292398

Merge pull request #20 from rraminen/PR_Update_Dockerfile

jithunnair-amd committed 4 years ago

Verified 0cf33069

undo noise (#1191)

stas00 committed 4 years ago

Verified bc019a53

Added h5py installation

rraminen committed 4 years ago

f6c79ae3

Added CuPy installation from source

rraminen committed 4 years ago

1d20b14a

Fix bugs about non-contiguous tensor broadcasting (#1168)

hyunwoongko committed 4 years ago

Verified 429cbc89

Enable cooperative groups for ROCm

rraminen committed 4 years ago

742fd648

Revert "Enable cooperative groups for ROCm"

rraminen committed 4 years ago

ed2ee34e

Added defined(__HIP_PLATFORM_HCC__) to kernels code

rraminen committed 4 years ago

f428da58

introduce debug utils (#1136)

stas00 committed 4 years ago

Verified c0c4ebf1

ZeRO 2+3 memory estimators (#965)

stas00 committed 4 years ago

Verified 0c1802cc

zero_to_fp32: restore persistent buffers (#1146)

stas00 committed 4 years ago

Verified df8b1f88

Revert "Cooperative Groups workaround for transformer kernels extension"

rraminen committed 4 years ago

0be96458

Added back the required code from the commits, 1c69737e1a8a8ae5ed9d295937458d54a65f4702 and 7be71d322e2e4e33a1dc6b85044e23d4e54b0283

rraminen committed 4 years ago

2585f291

Revert "Update headers and include_dirs to enable transformer extension (#8)"

rraminen committed 4 years ago

f50fa7b9

Revert "Add patched CG headers to rocm install path (#9)"

rraminen committed 4 years ago

d2966650

jeffra committed 4 years ago

0982ecca

remove torchvision dependency (#1178)

jeffra committed 4 years ago

Verified 3b689844

Avoid partitioning small activations (#1154)

tjruwase committed 4 years ago

Verified b1669c0d

add assert to make sure zero isn't enabled with 1bit-* (#1169)

jeffra committed 4 years ago

Verified 1ba3e8e3

patch in ompi local rank if local_rank isn't set (#1164)

jeffra committed 4 years ago

Verified 4c114a27

Remove hard torch dependency at install (#1166)

jeffra committed 4 years ago

Verified da1fe2f8

[Doc] Fix steps_per_print description (#1163)

tjruwase committed 4 years ago

Verified fa7921e2

Samyamr/largest partitioned params calculation fix (#1150)

samyam committed 4 years ago

Verified 4eaf9106

Fix bugs in the tutorial documentation (#1157)

hyunwoongko committed 4 years ago

Verified aa16828c

Newer Older