BF16 param weight
#6655

Open

Support the parallel conversion from ZeRO checkpoints to FP32/FP16/BF16 param weight #6655

xylian86 wants to merge 11 commits into deepspeedai:master from xylian86:parallel_zero_to_fp32_conversion

support the conversion from ZeRO checkpoints to FP32/FP16/BF16 parame…

7ee67344

not change the function name for compatibility

869c455f

nit

7c55f33d

xylian86 marked this pull request as ready for review 1 year ago

xylian86 requested a review from

tjruwase 1 year ago

xylian86 requested a review from

awan-10 1 year ago

Merge branch 'master' into parallel_zero_to_fp32_conversion

cf2983b9

Merge branch 'master' into parallel_zero_to_fp32_conversion

55794d99

loadams removed review request from

awan-10 1 year ago

loadams requested a review from

tohtana 1 year ago

fix formatting issue

ff1083c8

Merge branch 'master' into parallel_zero_to_fp32_conversion

d8fd142e

Merge branch 'master' into parallel_zero_to_fp32_conversion

901bb0e7

Merge branch 'master' into parallel_zero_to_fp32_conversion

ccbe369b

Merge branch 'master' into parallel_zero_to_fp32_conversion

52f00c56

Merge branch 'master' into parallel_zero_to_fp32_conversion

16b64fd0

loadams assigned

loadams 299 days ago

Reviewers

tjruwase

tohtana

Assignees

loadams

Labels

None yet

Milestone

No milestone