Skip stable-diffusion-2 on TorchBench CI (#2656)
Summary:
This is to keep TorchBench CI sane https://github.com/pytorch/benchmark/actions/runs/19517161639/job/55876678836?pr=2654 while waiting for the outcome of https://github.com/pytorch/pytorch/issues/167895. If we decide to not depend on this model anymore, it will be cleaner to just delete its code
Pull Request resolved: https://github.com/pytorch/benchmark/pull/2656
Reviewed By: xuzhao9
Differential Revision: D87698679
Pulled By: huydhn
fbshipit-source-id: ddb7669271cfa7315c9c3ba382fdfdb1ec9ff127