DeepSpeed
d88d9279
- ZeRO-Infinity: support swapping misaligned sized fp16 tensors (#1076)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
ZeRO-Infinity: support swapping misaligned sized fp16 tensors (#1076) * Align fp16 param wap buffers * Integrating swap buffer manager for fp16 params * Support swapping misaligned fp16 parameters
References
#1076 - ZeRO-Infinity: support swapping misaligned sized fp16 tensors
Author
tjruwase
Parents
ee4deabd
Loading