Fix CI for VLMs (#35690)

Commit

1 year ago

Fix CI for VLMs (#35690) * fix some easy test * more tests * remove logit check here also * add require_torch_large_gpu in Emu3