DeepSpeed
e9e9d5b8
- ZeRO-Infinity: Swap into unaligned fp16 buffer (#1086)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
ZeRO-Infinity: Swap into unaligned fp16 buffer (#1086) * Align fp16 param wap buffers * Integrating swap buffer manager for fp16 params * Support swapping misaligned fp16 parameters * Support swap into unaligned fp16 buffer
References
#1086 - ZeRO-Infinity: Swap into unaligned fp16 buffer
Author
tjruwase
Parents
c1550b89
Loading