deepspeedai/DeepSpeed

Pull Requests Commits

jeffra committed 3 years ago

3be6de14

don't convert None->Parameter during replace module

jeffra committed 3 years ago

692e004f

jeffra committed 3 years ago

8d4c2e79

revert neox changes

jeffra committed 3 years ago

24e99798

jeffra committed 3 years ago

c53d2a32

fixes for attn_qkvb

jeffra committed 3 years ago

44a0aafd

jeffra committed 3 years ago

097449ca

Add Unidirectional Sparse Attention Type to BigBird and BSLongformer (#1959)

Quentin-Anthony committed 3 years ago

Verified 5208eb73

Update cpu_adam.py (#1968)

jeffra committed 3 years ago

Verified 737fee63

Update Gemfile.lock (#1966)

jeffra committed 3 years ago

Verified 79249428

Fix timer typo (#1964)

Quentin-Anthony committed 3 years ago

Verified 0d368932

Bump nokogiri from 1.13.4 to 1.13.6 in /docs (#1965)

dependabot[bot] committed 3 years ago

Verified e329e985

[launcher] add option to bypass ssh check (#1957)

liamcli committed 3 years ago

Verified 380d32f9

Add loss scale guard to avoid inf loop (#1958)

Quentin-Anthony committed 3 years ago

Verified 44085856

Enabling CUDA-graph for the bert-type models (#1952)

RezaYazdaniAminabadi committed 3 years ago

Verified a5adb90d

trivial fix (#1954)

kisseternity committed 3 years ago

Verified 5053217e

DeepSpeed needs to start cleaning up (#1947)

tjruwase committed 3 years ago

Verified 09f1ad5e

Fairseq support (#1915)

jeffra committed 3 years ago

Verified 50893458

[pipe] prevent deadlock with multiple evals sequence (#1944)

stas00 committed 3 years ago

Verified dbeadf16

fix step in adam (#1823)

szhengac committed 3 years ago

Verified de887185

Update partition_parameters.py (#1943)

manuelciosici committed 3 years ago

Verified ae43ba12

GatheredParameters - accept a tuple of params (#1941)

stas00 committed 3 years ago

Verified 73c0798b

jeffra committed 3 years ago

ff908ed7

Improve z3 trace management (#1916)

tjruwase committed 3 years ago

Verified 673cb608

Fix time error (#1934)

Codle committed 3 years ago

Verified a3b90030

[ZeRO-3] Rename confusing log message (#1932)

jeffra committed 3 years ago

Verified a8d26d6a

spell err (#1929)

kisseternity committed 3 years ago

Verified 89e37ef3

bf16 inference (#1917)

tjruwase committed 3 years ago

Verified af58f63d

Enable DeepSpeed inference on ROCm (#1922)

rraminen committed 3 years ago

Verified 96c8bf32

explictly add op_builder to manifest (#1920)

jeffra committed 3 years ago

Verified a160d957

Older