transformers
2b8a7e82 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485)

Commit

92 days ago

Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485) * Add whole word masking * Vectorize whole word masking functions * Unit test whole word masking * Remove support for TF in whole word masking

References

#39485 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

rjgleaton

Parents

226667ec

transformers 2b8a7e82 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485)

transformers
2b8a7e82 - Add Whole Word Masking and Padding Strategy to DataCollatorForLanguageModeling (#39485)