PR #4796 Minor fix: ZeRO-1 grad clipping

Minor fix: ZeRO-1 grad clipping #4796

alanwaketan merged 2 commits into pytorch:master from hgt312:fix_zero1

JackCaoG requested a review from

alanwaketan 3 years ago

JackCaoG requested a review from

AlexWertheim 3 years ago

JackCaoG added fsdp

init

9221b721

fix

168e44d9

hgt312 force pushed from 357dc0cb to 168e44d9 3 years ago

alanwaketan approved these changes on 2023-05-02

alanwaketan merged 71f9a350 into master 3 years ago

Reviewers

alanwaketan

AlexWertheim

Assignees

No one assigned

Labels

fsdp

Milestone

No milestone