transformers.js
Add return_offset_mapping support to PreTrainedTokenizer
#1702
Open
Open
Add return_offset_mapping support to PreTrainedTokenizer #1702
anidoesdev
wants to merge
4 commits into
huggingface:main
from
anidoesdev:main
added return_offset_mapping support to PreTrainedTokenizer
fa94faa1
Add JSDoc limitations note to return_offset_mapping option
d9db4ec6
auto-fix formatting
24ffdfef
nico-martin
requested changes
on 2026-06-08
spell_error
15146b95
Login to write a write a comment.
Login via GitHub