DeepSpeed
fix: When there are tensors registered with register buffer in the weight file, the weights are only loaded on device 0 when loading weights across multiple devices.
#7717
Open
Open
fix: When there are tensors registered with register buffer in the weight file, the weights are only loaded on device 0 when loading weights across multiple devices. #7717
KeeProMise
wants to merge
2 commits into
deepspeedai:master
from
KeeProMise:7709
loading weights across multiple devices
981f4fab
Merge branch 'master' into 7709
fcc3a1d2
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub