Fix CI read-only cache failures by patching cached_files in conftest (#47043)
* update
* Add docstring to _with_tmpdir_cache_fallback
* Trigger to make sure things works
* Trigger to make sure things works
* Trigger to make sure things works
* Fix XET cache path in read-only cache fallback by also patching os.environ
* Revert vit test change (was only for read-only cache testing)
* Update docstring to reflect actual retry mechanism (cache_dir kwarg + HF_XET_CACHE)
* Fix InputTokensDetails missing cache_write_tokens for openai>=2.34.0
* Revert "Fix InputTokensDetails missing cache_write_tokens for openai>=2.34.0"
This reverts commit eb7839e995e6af9ffd730bcbabf26a20a3708f2c.
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>