DeepSpeed
Revert "BF16 optimizer: Clear lp grads after updating hp grads in hook"
#6508
Merged
Overview
Commits
1
Changes
View On GitHub

Revert "BF16 optimizer: Clear lp grads after updating hp grads in hook" #6508

loadams merged 1 commit into deepspeedai:master from nelyahu:revert-5328-yq/fix-lp-grads-clear
nelyahu
nelyahu Revert "BF16 optimizer: Clear lp grads after updating hp grads in hoo…
509f0e41
nelyahu nelyahu requested a review from tjruwase tjruwase 1 year ago
YangQun1
tjruwase
tjruwase approved these changes on 2024-09-09
loadams loadams merged 8fa6b50b into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum