transformers
[UDOP] Add special tokens to tokenizer
#29594
Merged

[UDOP] Add special tokens to tokenizer #29594

NielsRogge
NielsRogge Add special tokens
af6b3013
NielsRogge Add special tokens
f4fb474b
NielsRogge Use fmt
5a15a02a
NielsRogge Uncomment code
6df7ee56
NielsRogge Add test
a036a6e9
NielsRogge Remove scripts
3543e202
HuggingFaceDocBuilderDev
NielsRogge
NielsRogge commented on 2024-03-11
ArthurZucker
ArthurZucker commented on 2024-03-17
NielsRogge Address comments
c1f582fb
NielsRogge Improve tests
effd9e72
NielsRogge
ArthurZucker
NielsRogge Address comment
54fd234e
NielsRogge
NielsRogge NielsRogge requested a review from ArthurZucker ArthurZucker 1 year ago
ArthurZucker
ArthurZucker approved these changes on 2024-04-17
NielsRogge
ArthurZucker
NielsRogge
NielsRogge Remove flag
5827eeb3
NielsRogge NielsRogge merged ecfe9be7 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone