DeepSpeed
Fix gradient clipping
#5150
Merged

Fix gradient clipping #5150

tjruwase merged 2 commits into master from tohtana/fix_fp32_clipping
tohtana
fix gradient clipping
794e9921
tohtana tohtana marked this pull request as ready for review 1 year ago
tohtana tohtana requested a review from mrwyattii mrwyattii 1 year ago
tohtana tohtana requested a review from tjruwase tjruwase 1 year ago
tohtana tohtana requested a review from loadams loadams 1 year ago
tjruwase
tjruwase approved these changes on 2024-02-20
loadams Merge branch 'master' into tohtana/fix_fp32_clipping
98714212
loadams
loadams approved these changes on 2024-02-20
tjruwase tjruwase merged 005afe12 into master 1 year ago
cloneofsimo
tohtana
tohtana tohtana deleted the tohtana/fix_fp32_clipping branch 1 year ago
cloneofsimo
SeunghyunSEO

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone