DeepSpeed
Change default `set_to_none=true` in `zero_grad` methods
#4438
Merged

Change default `set_to_none=true` in `zero_grad` methods #4438

Jackmin801
Jackmin801 change default set_to_none in zero_grad methods
dc43b5fa
Jackmin801 Jackmin801 requested a review from jeffra jeffra 2 years ago
Jackmin801 Jackmin801 requested a review from tjruwase tjruwase 2 years ago
Jackmin801 Jackmin801 requested a review from samyam samyam 2 years ago
Jackmin801 Jackmin801 requested a review from mrwyattii mrwyattii 2 years ago
Jackmin801
tjruwase
tjruwase approved these changes on 2023-10-03
tjruwase
tjruwase tjruwase merged 2f73b834 into master 2 years ago
Jackmin801 Jackmin801 deleted the match-pt-zero-grad branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone