[ci] remove ppc64ie build env
We don't run this in the CI (not sure if we ever did!), so removing the
dead code paths
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79213
Approved by: https://github.com/kit1980, https://github.com/malfet, https://github.com/seemethere
