Revert "Fixes maybe_broadcast to actually broadcast only when needed (#79298)"
This reverts commit 1cb1c2c08cf8d4ce62d3d861b931df2e579872c0.
Reverted https://github.com/pytorch/pytorch/pull/79298 on behalf of https://github.com/suo due to Broke FakeTensor tests on master, see: https://hud.pytorch.org/pytorch/pytorch/commit/1cb1c2c08cf8d4ce62d3d861b931df2e579872c0
