transformers.js
12edaf08 - Use `PROBLEMATIC_REGEX_MAP` for bloom tokenizer

Commit

224 days ago

Use `PROBLEMATIC_REGEX_MAP` for bloom tokenizer

References

#545 - 🚀🚀🚀 Transformers.js V3 🚀🚀🚀

Author

xenova

xenova

Parents

Files1

src
- tokenizers.js