transformers

Update a test to avoid writing to the default xet cache

#46250

Merged