transformers
ea31b0c6 - Align special tokens on the text config (#48847)

Commit
65 days ago
Align special tokens on the text config (#48847) * Align special tokens on the text config On a composite model the special token ids live on the text sub-config, and the top-level config does not forward attribute lookups to it, so align_special_tokens read None, reported a mismatch on every run and wrote the ids onto the top-level config. Reading and writing through get_text_config() fixes it; the method returns the config itself for a text-only model, so nothing changes there. * Drop the comment --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Author
Parents
Loading