PR #4088 Fix for lm head weights for models such as llama

Fix for lm head weights for models such as llama #4088

puneeshkhanna wants to merge 6 commits into deepspeedai:master from puneeshkhanna:llama_lm_head

Fix for lm head weights for models such as llama.

99ed8c78

puneeshkhanna requested a review from

RezaYazdaniAminabadi 2 years ago

puneeshkhanna requested a review from

jeffra 2 years ago

puneeshkhanna requested a review from

mrwyattii 2 years ago

puneeshkhanna requested a review from

awan-10 2 years ago

puneeshkhanna requested a review from

cmikeh2 2 years ago

puneeshkhanna requested a review from

arashb 2 years ago

Merge branch 'master' into llama_lm_head

d9b591ac

Merge branch 'master' into llama_lm_head

19f180f1

Merge branch 'master' into llama_lm_head

51f7cf35

molly-smith assigned

molly-smith 2 years ago

Merge branch 'master' into llama_lm_head

a0be8793

Merge branch 'master' into llama_lm_head

776d7c5d

molly-smith assigned

mrwyattii 2 years ago

polisettyvarma commented on 2023-09-21

tjruwase approved these changes on 2024-02-01

Reviewers

tjruwase

polisettyvarma

RezaYazdaniAminabadi

jeffra

mrwyattii

awan-10

cmikeh2

arashb

Assignees

mrwyattii

molly-smith

Labels

None yet

Milestone

No milestone

DeepSpeed Fix for lm head weights for models such as llama #4088 Open

Fix for lm head weights for models such as llama #4088

DeepSpeed
Fix for lm head weights for models such as llama
#4088

Open