PR #18057 XGLM - Fix Softmax NaNs when using FP16

XGLM - Fix Softmax NaNs when using FP16 #18057

ydshieh merged 4 commits into huggingface:main from gsarti:fix-xglm-fp16-nans

ydshieh approved these changes on 2022-07-07

ydshieh requested a review from

younesbelkada 3 years ago

ydshieh requested a review from

patrickvonplaten 3 years ago

ydshieh requested a review from

patil-suraj 3 years ago

younesbelkada approved these changes on 2022-07-07

patrickvonplaten commented on 2022-07-11

patrickvonplaten approved these changes on 2022-07-11

github-actions closed this 3 years ago

ydshieh commented on 2022-09-27

ydshieh reopened this 3 years ago

huggingface deleted a comment from github-actions on 2022-09-27

ydshieh force pushed 3 years ago

fix fp16 for xglm

d88dd2dd

Removed misleading comment

901d319b

Fix undefined variable

1eb09537

ydshieh force pushed to 1eb09537 3 years ago

younesbelkada commented on 2022-09-29

Update src/transformers/models/xglm/modeling_xglm.py

e16a0379

ydshieh merged 9d732fd2 into main 3 years ago

Reviewers

ydshieh

younesbelkada

patrickvonplaten

stas00

patil-suraj

Assignees

No one assigned

Labels

None yet

Milestone

No milestone