onnxruntime
Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule
#7078

Merged

Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule #7078

harshithapv merged 4 commits into master from havenka/ortmodule_deepspeed_pp_fairscale

adding samples for Deepspeed pipeline parallel and fairscale sharded …

64690158

harshithapv requested a review from

baijumeswani 4 years ago

harshithapv requested a review from

BowenBao 4 years ago

harshithapv requested a review from

liqunfu 4 years ago

harshithapv requested a review from

spandantiwari 4 years ago

harshithapv requested a review from

thiagocrepaldi 4 years ago

harshithapv requested a review 4 years ago

harshithapv changed the title ~~Adding samples for Deepspeed pipeline parallel and fairscale sharded optimizer with ORTModule~~ Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule 4 years ago

thiagocrepaldi commented on 2021-03-22

fixed typo in args

e2fd9c3a

harshithapv closed this 4 years ago

harshithapv reopened this 4 years ago

addressed Thiago's comments

421fd131

thiagocrepaldi commented on 2021-03-23

Update orttraining/orttraining/test/python/orttraining_test_ortmodule…

96325203

thiagocrepaldi approved these changes on 2021-03-23

baijumeswani commented on 2021-03-23

harshithapv merged 540eac25 into master 4 years ago

harshithapv deleted the havenka/ortmodule_deepspeed_pp_fairscale branch 4 years ago

Reviewers

thiagocrepaldi

baijumeswani

BowenBao

liqunfu

spandantiwari

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule #7078 Merged

Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule #7078

onnxruntime
Deepspeed pipeline parallel and fairscale sharded optimizer test samples with ORTModule
#7078

Merged