DeepSpeed
ZeRO-Infinity: support swapping misaligned sized fp16 tensors
#1076

Merged

Commits

Align fp16 param wap buffers

tjruwase committed 4 years ago
Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase/unaligned_fp16_param_swap

tjruwase committed 4 years ago
Integrating swap buffer manager for fp16 params

tjruwase committed 4 years ago
Support swapping misaligned fp16 parameters

tjruwase committed 4 years ago
Merge branch 'master' into olruwase/unaligned_fp16_param_swap

tjruwase committed 4 years ago