DeepSpeed
Automatic tensor parallelism v2
#2670
Merged
Overview
Commits
22
Changes
View On GitHub

Automatic tensor parallelism v2 #2670

tjruwase merged 22 commits into master from mosm/tp2
molly-smith
molly-smith loop through pipe.model
af709c8e
molly-smith tp_parser first draft
dd9173a4
molly-smith client_module must be type object
90333948
molly-smith Simplify layernorm tracking. Add unittest.
91dc69a7
molly-smith cleanup
4030df1a
molly-smith Add more models to unittest
e27c8946
molly-smith cleanup inference pytest for merging
fb11de1e
molly-smith Merge branch 'master' into mosm/tp2
15573a39
molly-smith Add unittest
9b0a5769
molly-smith cleanup
d493d3d6
molly-smith pre-commit
bc315d79
molly-smith unittest id and pytest marker
f9282f4f
molly-smith try marian for unittest
aa05857e
molly-smith precommit
64538f94
molly-smith molly-smith changed the title Mosm/tp2 Automatic tensor parallelism v2 2 years ago
molly-smith molly-smith marked this pull request as ready for review 2 years ago
molly-smith molly-smith requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
molly-smith molly-smith requested a review from jeffra jeffra 2 years ago
molly-smith molly-smith requested a review from mrwyattii mrwyattii 2 years ago
molly-smith molly-smith requested a review from awan-10 awan-10 2 years ago
molly-smith molly-smith requested a review from cmikeh2 cmikeh2 2 years ago
molly-smith molly-smith requested a review from arashb arashb 2 years ago
molly-smith molly-smith requested a review from tjruwase tjruwase 2 years ago
RezaYazdaniAminabadi
RezaYazdaniAminabadi approved these changes on 2023-01-23
molly-smith Move tp code to seperate file
2452131c
molly-smith Add new auto tp file
08e179bc
jeffra
jeffra commented on 2023-01-24
molly-smith pre-commit and type
e6335d30
mrwyattii
mrwyattii commented on 2023-01-24
molly-smith Update deepspeed/module_inject/auto_tp.py
8c52b21a
molly-smith Update deepspeed/module_inject/auto_tp.py
6da16ee9
molly-smith Update tests/unit/inference/test_inference.py
3181333e
molly-smith remove unused fillmask function
2c0d71fb
molly-smith Merge branch 'master' into mosm/tp2
9e59fd2d
tjruwase tjruwase merged d59b5729 into master 2 years ago
jeffra jeffra deleted the mosm/tp2 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum