transformers
Saving: copy the gathered files to CPU on all ranks at once
#51055
Open

Saving: copy the gathered files to CPU on all ranks at once #51055

michaelbenayoun wants to merge 1 commit into saving/consolidate from saving/parallel_gather
michaelbenayoun
michaelbenayoun perf: gather the files of a round in lockstep in save_sharded_state_dict
309bdd76
michaelbenayoun michaelbenayoun force pushed from 09edf369 to 309bdd76 1 day ago
HuggingFaceDocBuilderDev

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone