microsoft/DeepSpeed

Pull Requests Commits

tjruwase committed 1 year ago

a1c41e02

Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase/ds_2921

tjruwase committed 1 year ago

f638d922

Add missing RocBlas include (#4557)

loadams committed 1 year ago

Verified 869629c2

pipe engine _aggregate_total_loss: more efficient loss concatenation (#4327)

nelyahu committed 1 year ago

Verified a02de228

Fix RTD builds (#4558)

mrwyattii committed 1 year ago

Verified 0f2338f7

tjruwase committed 1 year ago

f25ff5b1

Merge branch 'master' into olruwase/ds_2921

tjruwase committed 1 year ago

Verified 507fee84

Detect bf16_optimizer

tjruwase committed 1 year ago

d1cefd61

ROCm 6.0 prep changes (#4537)

loadams committed 1 year ago

Verified e2383511

[docs] paper updates (#4543)

jeffra committed 1 year ago

Verified 488f7e2d

turn off I_MPI_PIN for impi launcher (#4531)

delock committed 1 year ago

Verified 04cd6af1

Switch from HIP_PLATFORM_HCC to HIP_PLATFORM_AMD (#4539)

loadams committed 1 year ago

Verified c7724c61

[docs] ZeRO infinity slides and blog (#4542)

jeffra committed 1 year ago

Verified a5b1cb1e

Added rocblas header (#4538)

rraminen committed 1 year ago

Verified 3e4a5871

[Bug fix] Add rope_theta for llama config (#4480)

cupertank committed 1 year ago

Verified beed962c

Fixed deepspeed.comm.monitored_barrier call (#4496)

Quentin-Anthony committed 1 year ago

Verified 8a93ded8

fix error type in ccl.py (#4521)

Liangliang-Ma committed 1 year ago

Verified a7358817

Add NPU FusedAdam support (#4343)

CurryRice233 committed 1 year ago

Verified 3e70a887

Merge branch 'master' into olruwase/ds_2921

tjruwase committed 1 year ago

Verified 3b9a3845

Handle replicated params

tjruwase committed 1 year ago

d737cbc7

clear redundant parameters in zero3 bwd hook (#4520)

inkcherry committed 1 year ago

Verified 2cbfb89a

Merge branch 'olruwase/ds_2921' of github.com:microsoft/DeepSpeed into olruwase/ds_2921

tjruwase committed 1 year ago

51b3af87

tjruwase committed 1 year ago

f5c6b2dd

Merge branch 'master' into olruwase/ds_2921

tjruwase committed 1 year ago

Verified f21a5de5

tjruwase committed 1 year ago

64d8c0d8

Remove logging fix to seperate PR. Relocate conversion script to avoid logging circular import issue

tjruwase committed 1 year ago

b13006bc

Merge branch 'master' into olruwase/ds_2921

tjruwase committed 1 year ago

Verified 3dc989ec

Enable uni_ckpt for z1

tjruwase committed 1 year ago

2a60f793

add available memory check to accelerators (#4508)

jeffra committed 1 year ago

Verified 12aedac6

Update README.md (#4518)

samadejacobs committed 1 year ago

Verified 78c518ed

Older