transformers
Fix ByteLevel alphabet missing when Sequence pretokenizer is used
#33556
Merged

Commits
  • Fix ByteLevel alphabet missing when Sequence pretokenizer is used
    umarbutler committed 1 year ago
  • Fixed formatting with `ruff`.
    umarbutler committed 1 year ago
Loading