transformers
083ec509 - nllb and test tok common read spm precompiled charsmap

Commit

235 days ago

nllb and test tok common read spm precompiled charsmap

References

#44255 - [vllm + v5 fix] handle TokenizersBackend fallback properly for v5

Author

itazap

itazap

Committer

itazap

itazap

Parents

Loading