transformers.js
11fdae56
- Add special tokens in text-generation pipeline if tokenizer requires (#1370)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
214 days ago
Add special tokens in text-generation pipeline if tokenizer requires (#1370) * Add special tokens in text-generation pipeline if tokenizer requires * Fix logits processors tests * Update bundles.test.js * Update comment * Formatting
References
#1370 - Add special tokens in text-generation pipeline if tokenizer requires
Author
xenova
Parents
2c32e1d9
Loading