DeepSpeed
Pass down the new DS inference config to replace_transformer_layer.
#2539

Merged

Commits

pass down the new DS inference config to replace_transformer_layer.

awan-10 committed 3 years ago
Merge branch 'master' into amawa/config-pass-down

awan-10 committed 3 years ago
Merge branch 'master' into amawa/config-pass-down

awan-10 committed 3 years ago
Merge branch 'master' into amawa/config-pass-down

awan-10 committed 3 years ago
remove quantize_settings and rename the ep_mp_group.

awan-10 committed 3 years ago
Fix model_config passing. Fixes gptj issue with wrong output.

awan-10 committed 3 years ago
Merge branch 'master' into amawa/config-pass-down

RezaYazdaniAminabadi committed 3 years ago
fix small bug in gpt-neo.

awan-10 committed 3 years ago