transformers
Update pipeline word heuristic to work with whitespace in token offsets
#18402
Merged
Merged
Update pipeline word heuristic to work with whitespace in token offsets #18402
sgugger
merged
3 commits into
huggingface:main
from
davidbenton:issue/18111
Update pipeline word heuristic to work with whitespace in token offsets
4cd6daec
Use smaller model, ensure expected tokenization
6b9410cf
davidbenton
commented
on 2022-08-01
Re-run CI (please squash)
25db166d
sgugger
approved these changes
on 2022-08-02
Login to write a write a comment.
Login via GitHub