onnxruntime
legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper
#9184
Merged
Overview
Commits
19
Changes
View On GitHub

legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper #9184

pengwa merged 19 commits into master from pengwa/opt_fp16_optimizer
pengwa
pengwa FP16_Optimizer Wrap
0b26d835
pengwa refine the code
d7231476
pengwa pengwa requested a review from baijumeswani baijumeswani 4 years ago
pengwa pengwa requested a review from BowenBao BowenBao 4 years ago
pengwa pengwa requested a review from liqunfu liqunfu 4 years ago
pengwa pengwa requested a review from SherlockNoMad SherlockNoMad 4 years ago
pengwa pengwa requested a review from thiagocrepaldi thiagocrepaldi 4 years ago
pengwa pengwa requested a review from tlh20 tlh20 4 years ago
pengwa pengwa added component:optimizer
pengwa pengwa removed component:optimizer
pengwa pengwa added component:ortmodule
pengwa allow model parallelism aggregation optional
4a205d6c
pengwa zero1 optimizer inefficient function override
ffed3300
SherlockNoMad
thiagocrepaldi
thiagocrepaldi commented on 2021-09-27
pengwa
pengwa
ytaous
ytaous commented on 2021-09-28
pengwa add deepspeed zero1 and zero2 - checkoverflow & clip norm
bcbc09f3
pengwa refine the code
17e12a54
pengwa minor fix
6a554eac
pengwa refine the code after validation
0955a107
pengwa Merge branch 'master' of https://github.com/microsoft/onnxruntime int…
c50cd289
pengwa fix modifier
8b416a7e
pengwa fix build
82708a90
pengwa fix a indent
7c84e010
pengwa pengwa changed the title FP16_Optimizer wrapper legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper 4 years ago
pengwa Merge branch 'master' of https://github.com/microsoft/onnxruntime int…
6a71c5cf
pengwa Merge branch 'master' of https://github.com/microsoft/onnxruntime int…
0d180751
SherlockNoMad
SherlockNoMad commented on 2021-10-12
SherlockNoMad
SherlockNoMad commented on 2021-10-12
SherlockNoMad
SherlockNoMad commented on 2021-10-12
SherlockNoMad
SherlockNoMad commented on 2021-10-12
SherlockNoMad
SherlockNoMad commented on 2021-10-12
pengwa resolve comments
bd5d4eb0
pengwa update the document
2da5bc31
pengwa refine comment
7d1d4d17
SherlockNoMad
SherlockNoMad dismissed these changes on 2021-10-13
baijumeswani
baijumeswani commented on 2021-10-13
pengwa refine with comments
5b5f4fae
pengwa pengwa dismissed their stale review via 5b5f4fae 4 years ago
pengwa refine after validation
71813f58
baijumeswani
baijumeswani approved these changes on 2021-10-13
pengwa
pengwa pengwa merged 5ee47e3f into master 4 years ago
pengwa pengwa deleted the pengwa/opt_fp16_optimizer branch 4 years ago
baijumeswani
pengwa

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum