transformers.js

ac0096e3 - Add default `token_type_ids` for multilingual-e5-* models (#403)

Add default `token_type_ids` for multilingual-e5-* models (#403) * Fix #267 & #324 Add default token_type_ids. Fix for multilingual-e5-* family. * Add add_token_types import * export `add_token_types` * Improvements --------- Co-authored-by: Joshua Lochner <admin@xenova.com>