transformers
Saving: copy the gathered files to CPU on all ranks at once
#51055
Open
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
Saving: copy the gathered files to CPU on all ranks at once
#51055
michaelbenayoun
wants to merge 1 commit into
saving/consolidate
from
saving/parallel_gather
perf: gather the files of a round in lockstep in save_sharded_state_dict
309bdd76
michaelbenayoun
force pushed
from
09edf369
to
309bdd76
1 day ago
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub