DeepSpeed
ZeRO-Infinity: Swap into unaligned fp16 buffer
#1086
Merged

ZeRO-Infinity: Swap into unaligned fp16 buffer #1086

tjruwase
tjruwase Align fp16 param wap buffers
d216163f
tjruwase Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase…
6b5bace1
tjruwase Integrating swap buffer manager for fp16 params
aa429bc8
tjruwase Support swapping misaligned fp16 parameters
1fca54f8
tjruwase Merge branch 'master' into olruwase/unaligned_fp16_param_swap
42825bc9
tjruwase Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase…
b4b5f665
tjruwase Support swap into unaligned fp16 buffer
1a4c70c4
tjruwase Merge branch 'olruwase/unaligned_fp16_param_swap' of github.com:micro…
38d46848
tjruwase tjruwase requested a review from eltonzheng eltonzheng 4 years ago
tjruwase tjruwase requested a review from arashashari arashashari 4 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 4 years ago
tjruwase tjruwase requested a review from cli99 cli99 4 years ago
tjruwase tjruwase requested a review from conglongli conglongli 4 years ago
tjruwase tjruwase requested a review from jeffra jeffra 4 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 4 years ago
tjruwase tjruwase requested a review from niumanar niumanar 4 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
tjruwase tjruwase requested a review from samyam samyam 4 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 4 years ago
eltonzheng
eltonzheng approved these changes on 2021-05-20
tjruwase tjruwase merged e9e9d5b8 into master 4 years ago
mrwyattii mrwyattii deleted the olruwase/unaligned_fp16_param_swap branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone