Ci fetches multimodal models recursively (#49389)
* add backbones reverse check
* recurse for deeply nested configs
* test like this or should we patch?
* these are grabbed by reverse modular
* apply suggestion
* split more into fn and use PATH_TO_REPO
