transformers

95e70575 - Make vilt, switch_transformers compatible with model parallelism (#22703)

Make vilt, switch_transformers compatible with model parallelism (#22703) * Update modeling_vilt.py Vilt compatible with model parallelism * Update modeling_switch_transformers.py switch_transformers compatible with model parallelism