DeepSpeed
38a00bee - correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)

Commit

3 years ago

correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)

References

#2058 - Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE

Author

siddharth9820

siddharth9820

Parents

Loading