PR #3399 Add ZeRO 1 support to PP for BF16.

Add ZeRO 1 support to PP for BF16. #3399

tjruwase merged 4 commits into master from jomayeri/bf16-pp-fix

Add ZeRO 1 support to PP for BF16.

09919e34

jomayeri requested a review from

tjruwase 2 years ago

jomayeri requested a review from

ShadenSmith 2 years ago

jomayeri requested a review from

duli2012 2 years ago

tjruwase commented on 2023-04-28

tjruwase approved these changes on 2023-04-28

Switching enum.

de320841

Merge branch 'master' into jomayeri/bf16-pp-fix

925be77c

Merge branch 'master' into jomayeri/bf16-pp-fix

aab125ff

tjruwase enabled auto-merge (squash) 2 years ago

tjruwase merged dcb4a7d6 into master 2 years ago

mrwyattii deleted the jomayeri/bf16-pp-fix branch 2 years ago

Reviewers

tjruwase

ShadenSmith

duli2012

Assignees

No one assigned

Labels

None yet

Milestone

No milestone