microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified d4712b99

fix "ERROR: failed to solve: nvidia/cuda:11.7.0-devel-ubuntu18.04: docker.io/nvidia/cuda:11.7.0-devel-ubuntu18.04: not found" (#3930)

KaiChen1008 committed 1 year ago

Verified 45cecc05

add xTrimoPGLM (#3940)

jeffra committed 1 year ago

Verified aa54dba0

Update zero_to_fp32.py (#3936)

PicoCreator committed 1 year ago

Verified 103884ae

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified 7bfeca1f

Reduce Unit Test Times (Part 3) (#3850)

mrwyattii committed 1 year ago

Verified aef6c65c

remove the call to param.ds_tensor from print (#3928)

HeyangQin committed 1 year ago

Verified e59f69a8

Del comment deepspeed.zero.Init() can be used as a decorator (#3894)

hipudding committed 1 year ago

Verified e292343d

fix: change ==NONE to is (#3923)

digger-yu committed 1 year ago

Verified ce535945

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified 7be6fb9b

fix some typo docs/ (#3917)

digger-yu committed 1 year ago

Verified 55243f3b

fix memory leak with zero-3 (#3903)

jeffra committed 1 year ago

Verified af9a622a

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified 310a0a9b

fix "undefined symbol: curandCreateGenerator" for quantizer op (#3846)

jinzhen-lin committed 1 year ago

Verified 7e8bcc07

[profiling][mics]Fix some issues for log_summary(). (#3899)

ys950902 committed 1 year ago

Verified c520d476

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified 50e36a64

[ROCm] Enable TestCUDABackward::test_backward unit tests (#3849)

rraminen committed 1 year ago

Verified d24629f4

Fix a typo of global variable in comm.py(#3852) (#3852)

hipudding committed 1 year ago

Verified c5e55d3d

avoid init for deepspeed backend first (#3893)

mrwyattii committed 1 year ago

Verified b58e0fa9

Avoid deprecation warnings in `CHECK_CUDA` (#3854)

Flamefire committed 1 year ago

Verified 9aeba94a

Merge branch 'master' into loadams/enable-amdmi200

loadams committed 1 year ago

Verified 750a0592

Update workflows for merge queue (#3892)

mrwyattii committed 1 year ago

Verified 52844f49

fix rnn flop profiler to compute flops instead of macs (#3833)

pinstripe-potoroo committed 1 year ago

Verified 3491e32d

fix error :Dictionary expression not allowed in type annotation Pylance (#3708)

digger-yu committed 1 year ago

Verified 97e7b841

Fix Meta Tensor checkpoint load for BLOOM models (#3885)

lekurile committed 1 year ago

Verified cc3a7c9c

Add GPTNeoX AutoTP support (#3778)

Yejing-Lai committed 1 year ago

Verified d6f62217

Separate ZeRO3 InflightParamRegistry for train and eval (#3884)

HeyangQin committed 1 year ago

Verified 9377921a

Extend HE-Lora test with Z3 support + Fix/add guard in HE for Z3 (#3883)

awan-10 committed 1 year ago

Verified db4638d1

Update apex installation to resolve apex's pyproject.toml issues. (#3745)

loadams committed 1 year ago

Verified 59c9b091

Make it a function

loadams committed 1 year ago

7144ff3d

Older