DeepSpeed
ZeRO-Infinity: support swapping misaligned sized fp16 tensors
#1076
Merged
Overview
Commits
5
Changes
View On GitHub

ZeRO-Infinity: support swapping misaligned sized fp16 tensors #1076

tjruwase merged 5 commits into master from olruwase/unaligned_fp16_param_swap
tjruwase
tjruwase Align fp16 param wap buffers
d216163f
tjruwase Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase…
6b5bace1
tjruwase Integrating swap buffer manager for fp16 params
aa429bc8
tjruwase Support swapping misaligned fp16 parameters
1fca54f8
tjruwase tjruwase requested a review from samyam samyam 4 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 4 years ago
tjruwase tjruwase requested a review from arashashari arashashari 4 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 4 years ago
tjruwase tjruwase requested a review from cli99 cli99 4 years ago
tjruwase tjruwase requested a review from conglongli conglongli 4 years ago
tjruwase tjruwase requested a review from jeffra jeffra 4 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 4 years ago
tjruwase tjruwase requested a review from niumanar niumanar 4 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 4 years ago
tjruwase Merge branch 'master' into olruwase/unaligned_fp16_param_swap
42825bc9
eltonzheng
eltonzheng approved these changes on 2021-05-16
tjruwase tjruwase merged d88d9279 into master 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum