transformers
Updates in Trainer to support new features in SM Model Parallel library
#15877
Merged
Overview
Commits
5
Changes
View On GitHub

Updates in Trainer to support new features in SM Model Parallel library #15877

sgugger merged 5 commits into huggingface:master from rahul003:smptp
rahul003
HuggingFaceDocBuilderDev
sgugger
sgugger approved these changes on 2022-03-01
rahul003
LysandreJik
Create optimizer after model creation for SMP
ab2eabeb
update dp_rank to rdp_rank for opt_state_dict
7935e3f8
update world_size and process_index for smp
fda39542
rahul003 Address comments
31210f75
rahul003 Lint fix
148544a4
rahul003
rahul003 rahul003 force pushed to 148544a4 3 years ago
sgugger sgugger merged 2eb7bb15 into master 3 years ago
sgugger

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum