microsoft/DeepSpeed

Pull Requests Commits

molly-smith committed 2 years ago

c28d3e06

Create automatic TP tutorial

molly-smith committed 2 years ago

5eb6c660

Merge branch 'mosm/module_parser' into mosm/mp_tutorial

molly-smith committed 2 years ago

016116dd

change matmul with F.linear (seems to have better performance)

Reza Yazdani committed 2 years ago

2f5489a7

Merge branch 'fix-opt-injection' into mosm/mp_tutorial

molly-smith committed 2 years ago

9f7b988e

Merge branch 'master' into fix-opt-injection

jeffra committed 2 years ago

Verified ed7b0096

docs: Update the recent url for Megatron-LM (#2564)

rapsealk committed 2 years ago

Verified bbe030c5

jeffra committed 2 years ago

c77d42dc

Merge branch 'master' into fix-opt-injection

tjruwase committed 2 years ago

Verified c35503a7

Fix invalid check of recorded parameter orders in zero stage3. (#2550)

inkcherry committed 2 years ago

Verified aeda7f9f

Merge branch 'master' into fix-opt-injection

tjruwase committed 2 years ago

Verified 88d20acc

Abstract accelerator (step 1) (#2504)

delock committed 2 years ago

Verified ffcf3846

add missing moe deprecated fields to inference config (#2556)

mrwyattii committed 2 years ago

Verified c5f85858

encoded ds config into command line argument when launching child processes in autotuning (#2524)

cli99 committed 2 years ago

Verified abe4fc6b

Report progress at gradient accumulation boundary (#2553)

ShijieZZZZ committed 2 years ago

Verified 340fc0cf

Merge branch 'master' into fix-opt-injection

RezaYazdaniAminabadi committed 2 years ago

Verified a9ebb450

Adding Gradient Accumulation Data Type Config (#2512)

jomayeri committed 2 years ago

Verified 21c28029

Merge branch 'master' into mosm/module_parser

tjruwase committed 2 years ago

Verified 0c9bdca7

Move modulelist function to parserpolicies

molly-smith committed 2 years ago

7de95e29

Remove import_string dependency

molly-smith committed 2 years ago

14409c2e

Pass down the new DS inference config to replace_transformer_layer. (#2539)

awan-10 committed 2 years ago

Verified 90ae6884

precommit whitespace

molly-smith committed 2 years ago

d6d8e987

Merge branch 'master' into mosm/module_parser

awan-10 committed 2 years ago

Verified 63327de3

Merge branch 'master' into fix-opt-injection

RezaYazdaniAminabadi committed 2 years ago

Verified a18f9ac8

Merge branch 'fix-opt-injection' of github.com:microsoft/DeepSpeed into fix-opt-injection

Reza Yazdani committed 2 years ago

01a9b5c5

Reza Yazdani committed 2 years ago

b6da4b65

Change Where DS/Triton is Used in Stable Diffusion (#2536)

cmikeh2 committed 2 years ago

Verified 5df1eea7

Merge branch 'master' into fix-opt-injection

RezaYazdaniAminabadi committed 2 years ago

Verified 383c75d6

Merge branch 'fix-opt-injection' of github.com:microsoft/DeepSpeed into fix-opt-injection

Reza Yazdani committed 2 years ago

1e4c3ea8

fix several issues

Reza Yazdani committed 2 years ago

a1d686f8

Older