transformers
c10decf7 - [Bart: example] drop columns that are exclusively pad_token_id… (#3400)

Commit
6 years ago
[Bart: example] drop columns that are exclusively pad_token_id… (#3400) * trim seq_len below 1024 if there are columns full of pad_token_id * Centralize trim_batch so SummarizationDataset can use it too
Author
Parents
Loading