transformers
2b8a7e82
- Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
85 days ago
Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485) * Add whole word masking * Vectorize whole word masking functions * Unit test whole word masking * Remove support for TF in whole word masking
References
#39485 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling
Author
rjgleaton
Parents
226667ec
Loading