transformers

[CB] Minor perf improvements and ty compatibility

#43521

Merged