transformers
2eb7bb15 - Updates in Trainer to support new features in SM Model Parallel library (#15877)
Commit
View On GitHub
Commit
3 years ago
Updates in Trainer to support new features in SM Model Parallel library (#15877) * Create optimizer after model creation for SMP * update dp_rank to rdp_rank for opt_state_dict * update world_size and process_index for smp * Address comments * Lint fix Co-authored-by: Cavdar <dcavdar@a07817b12d7e.ant.amazon.com>
Author
rahul003 rahul003
Parents
05c237ea
FAQ Terms Privacy Refunds Impressum
Loading