PR #756 Return unclipped gradient from `clip_grad_norm_`

Return unclipped gradient from `clip_grad_norm_` #756

sgugger merged 1 commit into huggingface:main from clip_norm-returns-norm

samuelstevens2 years ago

Returns the unclipped gradient from clip_grad_norm_ like torch.nn.utils.clip_grad_norm_ does.

Initially brought up in #641.

Return unclipped gradient from grad_clip_norm_

bc75eff1

HuggingFaceDocBuilderDev2 years ago (edited 2 years ago)

The documentation is not available anymore as the PR was closed or merged.

sgugger approved these changes on 2022-10-14

sgugger2 years ago

Thanks for working on this!

sgugger merged 693d4682 into main 2 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone