microsoft/DeepSpeed

Pull Requests Commits

allow turning off gas loss scaling

jeffra committed 3 years ago

ff750466

Fairseq support (#1915)

jeffra committed 3 years ago

Verified 50893458

[pipe] prevent deadlock with multiple evals sequence (#1944)

stas00 committed 3 years ago

Verified dbeadf16

fix step in adam (#1823)

szhengac committed 3 years ago

Verified de887185

Update partition_parameters.py (#1943)

manuelciosici committed 3 years ago

Verified ae43ba12

GatheredParameters - accept a tuple of params (#1941)

stas00 committed 3 years ago

Verified 73c0798b

jeffra committed 3 years ago

ff908ed7

Improve z3 trace management (#1916)

tjruwase committed 3 years ago

Verified 673cb608

Fix time error (#1934)

Codle committed 3 years ago

Verified a3b90030

[ZeRO-3] Rename confusing log message (#1932)

jeffra committed 3 years ago

Verified a8d26d6a

spell err (#1929)

kisseternity committed 3 years ago

Verified 89e37ef3

bf16 inference (#1917)

tjruwase committed 3 years ago

Verified af58f63d

Enable DeepSpeed inference on ROCm (#1922)

rraminen committed 3 years ago

Verified 96c8bf32

explictly add op_builder to manifest (#1920)

jeffra committed 3 years ago

Verified a160d957

lazy import fcntl (#1921)

mrwyattii committed 3 years ago

Verified b7fc00df

jeffra committed 3 years ago

eae1889e

bumped to v0.6.3

mrwyattii committed 3 years ago

dda03361

[zero-3] add bwd support for list/dict types returned in fwd (#1857)

jeffra committed 3 years ago

Verified a52cbf80

Inference PP changes for neox (#1899)

jeffra committed 3 years ago

Verified b4fcd98f

Fix OOM and type mismatch (#1884)

tjruwase committed 3 years ago

Verified 32d97976

fix launcher for reading env vars (#1907)

szhengac committed 3 years ago

Verified 4575b2b7

Improve ds_report output for HIP/ROCm (#1906)

mrwyattii committed 3 years ago

Verified 8cc8c003

Fix multiple zero 3 tracing errors (#1901)

tjruwase committed 3 years ago

Verified ef17c895

Use cuda events to improve timing for multi-stream execution (#1881)

tjruwase committed 3 years ago

Verified fee73135

cast bool when not supported by torch2cupy (#1894)

conglongli committed 3 years ago

Verified 66aae13d

[partition_parameters.py] better diagnostics (#1887)

stas00 committed 3 years ago

Verified fb00e6a1

Use f-strings where possible (#1900)

manuelciosici committed 3 years ago

Verified 3b5b92cb

fix file ordering (#1822)

szhengac committed 3 years ago

Verified 801c1723

bf16+pipeline parallelism (#1801)

tjruwase committed 3 years ago

Verified 56c52238

[docs] fix commonmarker security issue (#1892)

jeffra committed 3 years ago

Verified 9bf1e9af

Older