microsoft/DeepSpeed

Pull Requests Commits

GuanhuaWang committed 1 year ago

d4542ffd

Add missing RocBlas include (#4557)

loadams committed 1 year ago

Verified 869629c2

pipe engine _aggregate_total_loss: more efficient loss concatenation (#4327)

nelyahu committed 1 year ago

Verified a02de228

Fix RTD builds (#4558)

mrwyattii committed 1 year ago

Verified 0f2338f7

ROCm 6.0 prep changes (#4537)

loadams committed 1 year ago

Verified e2383511

[docs] paper updates (#4543)

jeffra committed 1 year ago

Verified 488f7e2d

turn off I_MPI_PIN for impi launcher (#4531)

delock committed 1 year ago

Verified 04cd6af1

Switch from HIP_PLATFORM_HCC to HIP_PLATFORM_AMD (#4539)

loadams committed 1 year ago

Verified c7724c61

[docs] ZeRO infinity slides and blog (#4542)

jeffra committed 1 year ago

Verified a5b1cb1e

Added rocblas header (#4538)

rraminen committed 1 year ago

Verified 3e4a5871

[Bug fix] Add rope_theta for llama config (#4480)

cupertank committed 1 year ago

Verified beed962c

Fixed deepspeed.comm.monitored_barrier call (#4496)

Quentin-Anthony committed 1 year ago

Verified 8a93ded8

fix error type in ccl.py (#4521)

Liangliang-Ma committed 1 year ago

Verified a7358817

Add NPU FusedAdam support (#4343)

CurryRice233 committed 1 year ago

Verified 3e70a887

clear redundant parameters in zero3 bwd hook (#4520)

inkcherry committed 1 year ago

Verified 2cbfb89a

add available memory check to accelerators (#4508)

jeffra committed 1 year ago

Verified 12aedac6

Update README.md (#4518)

samadejacobs committed 1 year ago

Verified 78c518ed

Ulysses: add col-ai evaluation (#4517)

samadejacobs committed 1 year ago

Verified 5bbbf41f

[CCLBackend] update API (#4378)

Liangliang-Ma committed 1 year ago

Verified 4fc181b0

add DeepSpeed4Science white paper (#4502)

conglongli committed 1 year ago

Verified 574fbc0d

Fix scale factor on flops profiler (#4500)

loadams committed 1 year ago

Verified a25a67a0

adding 8bit dequantization kernel for asym fine-grained block quantization in zero-inference (#4450)

stephen-youn committed 1 year ago

Verified 6c86ff39

Update ROCm verison (#4486)

loadams committed 1 year ago

Verified 427253b9

Allow env var for timeout (#4405)

BramVanroy committed 1 year ago

Verified 706a7256

Introduce pydantic_v1 compatibility module for pydantic>=2.0.0 support (#4407)

ringohoffman committed 1 year ago

Verified 604d701e

Remove DS_BUILD_UTILS reference (#4485)

loadams committed 1 year ago

Verified e7acee49

[create-pull-request] automated change (#4484)

mrwyattii committed 1 year ago

Verified 77a28371

fix missing package

mrwyattii committed 1 year ago

Verified e9503fe4

fix bad build command (#4483)

mrwyattii committed 1 year ago

Verified 923f3590

add lm_head and embed_out tensor parallel (#3962)

Yejing-Lai committed 1 year ago

Verified 6763e2de

Older