transformers.js
Add special tokens in text-generation pipeline if tokenizer requires
#1370

Merged

Add special tokens in text-generation pipeline if tokenizer requires #1370

xenova merged 5 commits into main from default-pipeline-options

Add special tokens in text-generation pipeline if tokenizer requires

9f491b95

Fix logits processors tests

31648563

Update bundles.test.js

f4c2d59b

Update comment

fa2f3349

Formatting

3501a774

xenova merged 11fdae56 into main 63 days ago

xenova deleted the default-pipeline-options branch 63 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone