flax
[NVIDIA] Use custom grad accumulation for FP8 params
#3623
Merged

[NVIDIA] Use custom grad accumulation for FP8 params #3623

kaixih
kaixih
kaixih
kaixih
cgarciae
cgarciae
zhangqiaorjc
kaixih
cgarciae
cgarciae
kaixih
cgarciae
kaixih Use custom grad accum for fp8 meta params
02913030
kaixih Add the full attr
54fa392b
kaixih Clean up
dd004c21
kaixih kaixih force pushed to dd004c21 2 years ago
kaixih
cgarciae
cgarciae approved these changes on 2024-02-27
cgarciae cgarciae added pull ready
zhangqiaorjc
zhangqiaorjc
copybara-service copybara-service merged e4282ee1 into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone