transformers
2b8a7e82 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485)

Commit
85 days ago
Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485) * Add whole word masking * Vectorize whole word masking functions * Unit test whole word masking * Remove support for TF in whole word masking
Author
Parents
Loading