[tests] add tests to check for graph breaks, recompilation, cuda syncs in pipelines during torch.compile() (#11085)
* test for better torch.compile stuff.
* fixes
* recompilation and graph break.
* clear compilation cache.
* change to modeling level test.
* allow running compilation tests during nightlies.