PR #4084 Fix Issue 4083

Fix Issue 4083 #4084

jomayeri merged 8 commits into master from jomayeri/issue-4083

removing bad check

6448c514

jomayeri requested a review from

jeffra 2 years ago

jomayeri requested a review from

tjruwase 2 years ago

jomayeri requested a review from

samyam 2 years ago

jomayeri requested a review from

mrwyattii 2 years ago

jomayeri assigned

jomayeri 2 years ago

tjruwase commented on 2023-08-03

adding offload check for bf16 optimizer

d8a47b65

tjruwase approved these changes on 2023-08-03

grad reduce for extra large param

d7f95869

Merge branch 'master' into jomayeri/issue-4083

05112483

Merge branch 'master' into jomayeri/issue-4083

06e1a9e2

Merge branch 'master' into jomayeri/issue-4083

854e4842

mrwyattii enabled auto-merge 2 years ago

check grad_accum exists before converting

cfda46e9

Merge remote-tracking branch 'refs/remotes/origin/jomayeri/issue-4083…

42c5381d

disabled auto-merge 2 years ago
Manually disabled by user

jomayeri merged 8a8683d3 into master 2 years ago

Reviewers

tjruwase

jeffra

samyam

mrwyattii

Assignees

jomayeri

Labels

None yet

Milestone

No milestone