remove assert on tensor inputs to FusionGroup (#88018)
Fixes #86530 #86227 #85872
All issues seem to be duplicate of each other.
Removes the false positive assert
Fixes come from @kevinstephano
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88018
Approved by: https://github.com/kevinstephano, https://github.com/soumith
