[Inductor Perf CI] Enable perf CI smoke test (#92051)
This tries to detect perf regression e.g. https://github.com/pytorch/pytorch/pull/91316#issuecomment-1370370885
Pull Request resolved: https://github.com/pytorch/pytorch/pull/92051
Approved by: https://github.com/seemethere, https://github.com/desertfire
