benchmark
9e418359 - Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001)

Commit
190 days ago
Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001) Summary: GPT2ForSequenceClassification Hugging Face (HF) model fails on ROCm for bfloat16. The failure is numerically small. This PRs adds this model to an exception list for small tensors. The exception list already includes two models. This increases the multiplier factor to 10.0 instead of 3 (default) for this model used in `torch/_dynamo/utils.py`. In the PR comment below, I include a short analysis of the numerics. X-link: https://github.com/pytorch/pytorch/pull/160001 Approved by: https://github.com/anijain2305, https://github.com/jataylo, https://github.com/jeffdaily Reviewed By: seemethere Differential Revision: D80465664 fbshipit-source-id: 986a0cc2f9e23c73c9ed9e714020ae785c7b4a58
Author
generatedunixname499836121
Parents
Loading