DeepSpeed
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)
#7867
Open
Open
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747) #7867
harshang03
wants to merge
1 commit into
deepspeedai:master
from
harshang03:fix/7747-moe-bf16-fp32-pinned-params
fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3
808c88b9
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub