transformers.js
Allow older (legacy) BPE models to be detected even when the type is not specified.
#1314
Merged

Allow older (legacy) BPE models to be detected even when the type is not specified. #1314

xenova merged 2 commits into main from improve-bpe-detection
xenova
xenova Improve legacy BPE detection
2b0068ad
xenova Add legacy BPE unit test
2a81772d
HuggingFaceDocBuilderDev
xenova xenova merged a8413a99 into main 1 year ago
xenova xenova deleted the improve-bpe-detection branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone