ci: Don't install dependencies in tests that don't need it (#11071)
### Description
Seeing if we can cache dependencies for our integration test fixtures.
Since we have to operate against real repos for these, we install their
dependencies. But it looks like we were doing the dependency
installation from scratch every time. Now, we just do it once and bring
them back from disk.
### Testing Instructions
CI