transformers.js
795a61a3 - Update tokenizer unit tests

Commit

310 days ago

Update tokenizer unit tests

References

#545 - 🚀🚀🚀 Transformers.js V3 🚀🚀🚀

Author

xenova

xenova

Parents

Files3

tests
- models
  - bert
    - tokenization.js
  - roberta
    - tokenization.js
- tokenizers.test.js

Loading