DeepSpeed
Improve parallel process of universal checkpoint conversion
#5343
Merged

Improve parallel process of universal checkpoint conversion #5343

tohtana
improve parallel process of universal checkpoint conversion
79c81b0d
tohtana tohtana requested a review from tjruwase tjruwase 2 years ago
tohtana tohtana changed the title improve parallel process of universal checkpoint conversion Improve parallel process of universal checkpoint conversion 2 years ago
tjruwase
tjruwase approved these changes on 2024-04-01
tjruwase
tohtana
tohtana tohtana enabled auto-merge 2 years ago
tohtana Merge branch 'master' into tohtana/ds_to_univ_parallel_pool
4bcd52c1
tohtana Merge branch 'master' into tohtana/ds_to_univ_parallel_pool
1858199c
tohtana Merge branch 'microsoft:master' into tohtana/ds_to_univ_parallel_pool
9ddb378a
Fixed non-parallel path
b334af74
refactor utility func for parallel work
366ec3e4
tjruwase Merge branch 'master' into tohtana/ds_to_univ_parallel_pool
d4096e8d
tohtana tohtana merged c292b03a into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone