remove overly restrictive checks for cudagraph (#80881) (#81858)
Finish fixing https://github.com/pytorch/pytorch/issues/80809
Pull Request resolved: https://github.com/pytorch/pytorch/pull/80881
Approved by: https://github.com/jbschlosser
Co-authored-by: albanD <desmaison.alban@gmail.com>
