DeepSpeed
Pass down the new DS inference config to replace_transformer_layer.
#2539

Merged

Pass down the new DS inference config to replace_transformer_layer. #2539

awan-10 merged 8 commits into master from amawa/config-pass-down

pass down the new DS inference config to replace_transformer_layer.

cc9253a6

awan-10 requested a review from

RezaYazdaniAminabadi 3 years ago

awan-10 requested a review from

jeffra 3 years ago

awan-10 requested a review from

mrwyattii 3 years ago

awan-10 requested a review from

cmikeh2 3 years ago

awan-10 requested a review from

arashb 3 years ago

Merge branch 'master' into amawa/config-pass-down

b6889f06

mrwyattii commented on 2022-11-22

Merge branch 'master' into amawa/config-pass-down

2a454a5f

Merge branch 'master' into amawa/config-pass-down

d4608a11

remove quantize_settings and rename the ep_mp_group.

bf718731

Fix model_config passing. Fixes gptj issue with wrong output.

c921059a

RezaYazdaniAminabadi approved these changes on 2022-11-23

Merge branch 'master' into amawa/config-pass-down

b8ee710d

fix small bug in gpt-neo.

08dd2b11

mrwyattii commented on 2022-11-23

mrwyattii approved these changes on 2022-11-23

awan-10 enabled auto-merge (squash) 3 years ago

awan-10 assigned

awan-10 3 years ago

awan-10 assigned

mrwyattii 3 years ago

awan-10 merged 90ae6884 into master 3 years ago

Reviewers

mrwyattii

RezaYazdaniAminabadi

jeffra

cmikeh2

arashb

Assignees

awan-10

mrwyattii

Labels

None yet

Milestone

No milestone

DeepSpeed Pass down the new DS inference config to replace_transformer_layer. #2539 Merged

Pass down the new DS inference config to replace_transformer_layer. #2539

DeepSpeed
Pass down the new DS inference config to replace_transformer_layer.
#2539

Merged