Clean workspace before everything
Cleaning the workspace should probably be the first thing we do; in
particular we should do it before chowning to avoid weird crap like https://github.com/pytorch/pytorch/runs/4745397439?check_suite_focus=true.
This also removes the redundant `git clean` after checkout, which should
not do anything anymore now that we are nuking the workspace beforehand.
