be more consrevative until regression is debugged (#119583)
See, internal regression: https://www.internalfb.com/diff/D53375778?transaction_fbid=953511712782168
Pull Request resolved: https://github.com/pytorch/pytorch/pull/119583
Approved by: https://github.com/Chillee
