DeepSpeed
d88d9279 - ZeRO-Infinity: support swapping misaligned sized fp16 tensors (#1076)

Commit
4 years ago
ZeRO-Infinity: support swapping misaligned sized fp16 tensors (#1076) * Align fp16 param wap buffers * Integrating swap buffer manager for fp16 params * Support swapping misaligned fp16 parameters
Author
Parents
Loading