transformers

Fix number of patch check for different vision feature select strategy

#32494

Merged