DeepSpeed
46784cb5 - Fix auto TP for duplicate modules with different gems (#2784)

Commit
2 years ago
Fix auto TP for duplicate modules with different gems (#2784) * Fix auto TP for duplicate modules with different gems * precommit and comments * Comment * Combine gem list of same named modules * remove duplicates from gem_list before updating policy * Add module attribute with name variation for ProphetNet --------- Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Author
Parents
Loading