PR #35808 Fix GA loss for Deepspeed

Fix GA loss for Deepspeed #35808

ArthurZucker merged 3 commits into huggingface:main from timjeffrey10:fix-deepspeed-GA

Fix GA loss for Deepspeed

73b688fe

timjeffrey10 force pushed to 73b688fe 1 year ago

muellerzr commented on 2025-01-21

Turn off loss scaling in DeepSpeed engine by scale_wrt_gas

30824ced

muellerzr approved these changes on 2025-01-22

Add comment linking to PR

e655d879

muellerzr requested a review from

ArthurZucker 1 year ago

muellerzr requested a review from

SunMarc 1 year ago

ArthurZucker approved these changes on 2025-01-23

ArthurZucker merged 4ec425ff into main 1 year ago

Reviewers

ArthurZucker

muellerzr

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone