Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001)
Summary:
GPT2ForSequenceClassification Hugging Face (HF) model fails on ROCm for bfloat16. The failure is numerically small. This PRs adds this model to an exception list for small tensors. The exception list already includes two models. This increases the multiplier factor to 10.0 instead of 3 (default) for this model used in `torch/_dynamo/utils.py`.
In the PR comment below, I include a short analysis of the numerics.
X-link: https://github.com/pytorch/pytorch/pull/160001
Approved by: https://github.com/anijain2305, https://github.com/jataylo, https://github.com/jeffdaily
Reviewed By: seemethere
Differential Revision: D80465664
fbshipit-source-id: 986a0cc2f9e23c73c9ed9e714020ae785c7b4a58
Author
generatedunixname499836121