benchmark
76d4920a - Update TorchBench commit to main (#145455)

Commit
358 days ago
Update TorchBench commit to main (#145455) Summary: I'm adding sam2 to TorchBench https://github.com/pytorch/benchmark/issues/2566, so, as part of that, I'm updating PyTorch CI to use latest TorchBench commit. The corresponding change from TorchBench is https://github.com/pytorch/benchmark/pull/2584 The main thing to call out that the newer transformers added by https://github.com/pytorch/benchmark/pull/2488 is regressing several models. This needs to be investigated further, and I pin the version to unblock this change. * `hf_Roberta_base` a new model added by https://github.com/pytorch/benchmark/pull/2279, not sure why it fails accuracy on A10G, but it works fine on A100 * `speech_transformer` failures are pre-existing trunk failures, i.e. https://github.com/pytorch/pytorch/actions/runs/13040114684/job/36380989702#step:22:2408 X-link: https://github.com/pytorch/pytorch/pull/145455 Approved by: https://github.com/kit1980 Reviewed By: ZainRizvi Differential Revision: D69056903 fbshipit-source-id: 6b98c246b9dc8811257ec46d4821ba6ee3363dfe
Author
Parents
Loading