chore: Remove old benchmarking code (#11274)
### Description
We used to run these benchmarks. I don't really know why, and they're
not useful anymore.
We're going to be using Codspeed soon, so we can get this out of the
way.
### Testing Instructions
CI
