BF16 param weight
#6655

Open

Commits

support the conversion from ZeRO checkpoints to FP32/FP16/BF16 parameter weights in parallel via UCP

xylian86 committed 1 year ago
not change the function name for compatibility

xylian86 committed 1 year ago
nit

xylian86 committed 1 year ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

loadams committed 1 year ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

loadams committed 1 year ago
fix formatting issue

xylian86 committed 1 year ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

tjruwase committed 1 year ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

xylian86 committed 325 days ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

xylian86 committed 325 days ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

loadams committed 315 days ago
Merge branch 'master' into parallel_zero_to_fp32_conversion

loadams committed 301 days ago