transformers
4f01369c - Allow position_ids_start=2 on DataCollatorWithFlattening for RoBERTa etc. (#47525)

Commit
115 days ago
Allow position_ids_start=2 on DataCollatorWithFlattening for RoBERTa etc. (#47525) * Allow position_ids_start=2 on DataCollatorWithFlattening for RoBERTa etc. * Add RoBERTa flash-attn integration test for position_ids_start * Use prepared inputs, set_attn_implementation and fp16 in RoBERTa padding-free test
Author
Parents
Loading