Fix various small problems #367
janEbert
wants to merge
3 commits into
bigscience-workshop:main
from
janEbert:misc-fixes
Fix covered index skipping
ce3f6c08
Fix GPT tokenizer vocab size query
f7c583f3
Do not remove last token
cfd6374e
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub