DeepSpeed
[INF] Add Qwen2RMSNorm to loaded layers in auto_tp
#5786

Merged

[INF] Add Qwen2RMSNorm to loaded layers in auto_tp #5786

loadams merged 2 commits into deepspeedai:master from oelayan7:qwen_rms

[INF] Add Qwen2RMSNorm to loaded layers in auto_tp

ea50c384

oelayan7 requested a review from

awan-10 1 year ago

oelayan7 requested a review from

arashb 1 year ago

loadams approved these changes on 2024-07-22

Merge branch 'master' into qwen_rms

15704c79

loadams enabled auto-merge 1 year ago

loadams merged 830d0c0a into master 1 year ago

oelayan7 deleted the qwen_rms branch 1 year ago

Reviewers

loadams

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone