transformers
[pipelines] add support to `skip_special_tokens` in the main text generation pipelines
#40356

Merged

[pipelines] add support to `skip_special_tokens` in the main text generation pipelines #40356

gante merged 3 commits into huggingface:main from gante:pipeline_skip_special_tokens

add support to skip_special_tokens in pipelines

1db8e99a

gante requested a review from

ArthurZucker 270 days ago

gante commented on 2025-08-21

ArthurZucker approved these changes on 2025-08-22

add test

553f3bc3

rm redundant

7246ef57

gante commented on 2025-08-22

gante enabled auto-merge (squash) 270 days ago

gante merged 9c258209 into main 270 days ago

gante deleted the pipeline_skip_special_tokens branch 270 days ago

Reviewers

ArthurZucker

Cyrilvallez

Assignees

No one assigned

Labels

None yet

Milestone

No milestone