PR #1235 Support load tokenizer from subfolder

Support load tokenizer from subfolder #1235

hans00 wants to merge 2 commits into huggingface:main from mybigday:tokenizer-subfolder

Support load tokenizer from subfolder

01a57bfe

prevent `subfolder` set false

c75499cb

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone