transformers
DeepSpeed ZeRO-3 handling when resizing embedding layers
#26259

Merged

DeepSpeed ZeRO-3 handling when resizing embedding layers #26259

pacman100 merged 2 commits into main from smangrul/ds_resize_emb_fix

fix failing deepspeed slow tests

62ab2b87

fixes

07e2d7b7

pacman100 requested a review from

muellerzr 2 years ago

pacman100 requested a review from

ArthurZucker 2 years ago

muellerzr approved these changes on 2023-09-19

pacman100 changed the title ~~Smangrul/ds resize emb fix~~ DeepSpeed ZeRO-3 handling when resizing embedding layers 2 years ago

ArthurZucker approved these changes on 2023-09-19

pacman100 merged ffbf989f into main 2 years ago

pacman100 deleted the smangrul/ds_resize_emb_fix branch 2 years ago

Reviewers

ArthurZucker

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone