PR #19426 made tokenization_roformer independent of bert

made tokenization_roformer independent of bert #19426

sgugger merged 5 commits into huggingface:main from naveennamani:roformer_tokenizer_independent

made tokenization_roformer independent of bert

63679056

added missing imports

4c579afd

added missing function and import

eea6fd41

sgugger commented on 2022-10-11

Fixed copy commands

f66709da

naveennamani requested a review from

sgugger 3 years ago

sgugger commented on 2022-10-11

Update tokenization_roformer.py

42214758

naveennamani requested a review from

sgugger 3 years ago

sgugger approved these changes on 2022-10-12

sgugger merged 2720d5fc into main 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone