transformers.js
11fdae56 - Add special tokens in text-generation pipeline if tokenizer requires (#1370)

Commit
214 days ago
Add special tokens in text-generation pipeline if tokenizer requires (#1370) * Add special tokens in text-generation pipeline if tokenizer requires * Fix logits processors tests * Update bundles.test.js * Update comment * Formatting
Author
Parents
Loading