microsoft/DeepSpeed

Pull Requests Commits

change matmul with F.linear (seems to have better performance)

Reza Yazdani committed 3 years ago

2f5489a7

Drop Maxwell Support (#2574)

cmikeh2 committed 3 years ago

Verified b8416282

Support fp32 gradaccum for bf16 model (#2566)

delock committed 3 years ago

Verified 06938835

Add Determined to open-source DL frameworks (#2573)

sirredbeard committed 3 years ago

Verified 2d8f3f56

use get_global_rank if available (#2567)

jeffra committed 3 years ago

Verified d4cab2ce

docs: Update the recent url for Megatron-LM (#2564)

rapsealk committed 3 years ago

Verified bbe030c5

jeffra committed 3 years ago

c77d42dc

Fix invalid check of recorded parameter orders in zero stage3. (#2550)

inkcherry committed 3 years ago

Verified aeda7f9f

Abstract accelerator (step 1) (#2504)

delock committed 3 years ago

Verified ffcf3846

add missing moe deprecated fields to inference config (#2556)

mrwyattii committed 3 years ago

Verified c5f85858

encoded ds config into command line argument when launching child processes in autotuning (#2524)

cli99 committed 3 years ago

Verified abe4fc6b

Report progress at gradient accumulation boundary (#2553)

ShijieZZZZ committed 3 years ago

Verified 340fc0cf

Adding Gradient Accumulation Data Type Config (#2512)

jomayeri committed 3 years ago

Verified 21c28029

Merge branch 'master' into mosm/module_parser

tjruwase committed 3 years ago

Verified 0c9bdca7

Move modulelist function to parserpolicies

molly-smith committed 3 years ago

7de95e29

Remove import_string dependency

molly-smith committed 3 years ago

14409c2e

Pass down the new DS inference config to replace_transformer_layer. (#2539)

awan-10 committed 3 years ago

Verified 90ae6884

precommit whitespace

molly-smith committed 3 years ago

d6d8e987

Merge branch 'master' into mosm/module_parser

awan-10 committed 3 years ago

Verified 63327de3

Change Where DS/Triton is Used in Stable Diffusion (#2536)

cmikeh2 committed 3 years ago

Verified 5df1eea7

Remove mutable default parameter in init_inference() (#2540)

aphedges committed 3 years ago

Verified 4abf637f

Merge branch 'mosm/module_parser' of github.com:microsoft/DeepSpeed-internal into mosm/module_parser

molly-smith committed 3 years ago

30787e58

Fix some linear layers not being included in policy, fix self parent

molly-smith committed 3 years ago

b7982f90

Merge branch 'mosm/module_parser' of github.com:microsoft/DeepSpeed-internal into mosm/module_parser

Reza Yazdani committed 3 years ago

9dbed561

fix key by looping over module's children

Reza Yazdani committed 3 years ago

550b5f44

Add MII tests (#2533)

mrwyattii committed 3 years ago

Verified c5ee27f7

Make DS-Inference config readable from JSON (#2537)

mrwyattii committed 3 years ago

Verified 8b4318b9

try adding requirement to dev instead of inf

molly-smith committed 3 years ago

f3745585

import_string module requirement

molly-smith committed 3 years ago

3ca40ada

Ensure is initialized for SD (#2534)

cmikeh2 committed 3 years ago

Verified 57e0a550

Newer Older