Owlvit test fixes (#18303)

Commit

3 years ago

Owlvit test fixes (#18303) * fix owlvit test assertion errors * fix gpu test error * remove redundant lines * fix styling