transformers

1a7ef334 - Fix broken test for models with batchnorm (#17841)

Fix broken test for models with batchnorm (#17841) * Fix tests that broke when models used batchnorm * Initializing the model twice does not actually... ...give you the same weights each time. I am good at machine learning. * Fix speed regression