DeepSpeed
fix num_kv_heads sharding in uneven autoTP for Falcon-40b
#4712

Merged

fix num_kv_heads sharding in uneven autoTP for Falcon-40b #4712

mrwyattii merged 4 commits into deepspeedai:master from Yejing-Lai:lyj/fix_falcon40b

fix num_kv_heads sharding in uneven autoTP for Falcon-40b

8c125e84

Yejing-Lai requested a review from

RezaYazdaniAminabadi 2 years ago

Yejing-Lai requested a review from

jeffra 2 years ago

Yejing-Lai requested a review from

mrwyattii 2 years ago

Yejing-Lai requested a review from

awan-10 2 years ago

Yejing-Lai requested a review from

cmikeh2 2 years ago

Yejing-Lai requested a review from

arashb 2 years ago

Merge branch 'master' into lyj/fix_falcon40b

a5c2fe9f

tjruwase approved these changes on 2023-12-13

Merge branch 'master' into lyj/fix_falcon40b

01df63a9

mrwyattii approved these changes on 2024-01-05

Merge branch 'master' into lyj/fix_falcon40b

791865f9

mrwyattii merged 1787673e into master 1 year ago

Reviewers

tjruwase

mrwyattii

jeffra

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone