llama : set attrs of mislabelled EOT/EOM tokens #9348
llama : set attrs of mislabelled EOT/EOM tokens
91695ad4
compilade
approved these changes
on 2024-09-08
ggerganov
merged
fbb7fcff
into master 1 year ago
bakkot
deleted the handle-mislabeled-control-tokens branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub