transformers
ecfe9be7
- [UDOP] Add special tokens to tokenizer (#29594)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
[UDOP] Add special tokens to tokenizer (#29594) * Add special tokens * Add special tokens * Use fmt * Uncomment code * Add test * Remove scripts * Address comments * Improve tests * Address comment * Remove flag
References
#29594 - [UDOP] Add special tokens to tokenizer
Author
NielsRogge
Parents
d9850abd
Loading