transformers
Stop align_special_tokens from rewriting eos_token_id when no alignment is needed
#45917

Open

Stop align_special_tokens from rewriting eos_token_id when no alignment is needed #45917

1fanwang wants to merge 1 commit into huggingface:main from 1fanwang:fix/align-eos-side-effect

Don't unconditionally wrap generation_config.eos_token_id in align_sp…

da71920c

tedo001 commented on 2026-05-12

Reviewers

tedo001

Assignees

No one assigned

Labels

None yet

Milestone

No milestone