In group_texts function, drop last block if smaller than block_size #17908
In `group_texts` function, drop last block if smaller than `block_size`
b6beb267
SaulLu
approved these changes
on 2022-06-28
sgugger
approved these changes
on 2022-06-28
sgugger
merged
bfcd5743
into main 3 years ago
billray0259
deleted the bug_fix_language_modeling_task branch 3 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub