Add torch_lazy_all_numbers_special_scalars flag (#85902)
This is to allow even non zero and one scalars to appear as constants in the graph. The assumption being that none of them will change.
The flag is set to `false` by default to preserve the original behaviour.
CC: @wconstab @JackCaoG @ke1337 @vaibhavc-cerebras @glebk-cerebras
Pull Request resolved: https://github.com/pytorch/pytorch/pull/85902
Approved by: https://github.com/wconstab