accelerate
Update the default behavior of `zero_grad(set_to_none=None)` to align with PyTorch
#2472
Merged

Update the default behavior of `zero_grad(set_to_none=None)` to align with PyTorch #2472

muellerzr merged 3 commits into huggingface:main from yongchanghao:patch-1
yongchanghao
yongchanghao Update the default behavior of `zero_grad(set_to_none=None)`
81032c83
yongchanghao
HuggingFaceDocBuilderDev
muellerzr
muellerzr approved these changes on 2024-02-26
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr changed the title Update the default behavior of `zero_grad(set_to_none=None)` Update the default behavior of `zero_grad(set_to_none=None)` to align with PyTorch 2 years ago
BenjaminBossan
BenjaminBossan approved these changes on 2024-02-27
muellerzr
yongchanghao Merge branch 'huggingface:main' into patch-1
cfe93c56
yongchanghao Merge branch 'huggingface:main' into patch-1
5f8fc31d
yongchanghao
muellerzr muellerzr merged 145a98fc into main 2 years ago
muellerzr

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone