transformers
Fix idx2sym not loaded from pretrained vocab file in Transformer XL
#27589

Merged

Fix idx2sym not loaded from pretrained vocab file in Transformer XL #27589

ArthurZucker merged 2 commits into huggingface:main from jtang98:load-idx2sym-from-vocab-dict-for-transformer-xl-tokenizer

Load idx2sym from pretrained vocab file in Transformer XL

7aac1e8c

ran make style

58855da3

ArthurZucker approved these changes on 2023-11-20

ArthurZucker merged dbf7bfaf into main 2 years ago

jtang98 deleted the load-idx2sym-from-vocab-dict-for-transformer-xl-tokenizer branch 2 years ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone