Allow older (legacy) BPE models to be detected even when the type is not specified. #1314
Improve legacy BPE detection
2b0068ad
Add legacy BPE unit test
2a81772d
xenova
merged
a8413a99
into main 1 year ago
xenova
deleted the improve-bpe-detection branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub