transformers.js
f43d3dd3 - Update tokenizer unit tests (#919)

Commit
1 year ago
Update tokenizer unit tests (#919) * Ignore kobert from unit tests (now requires `trust_remote_code=True` * Remove tokenizers without chat template
Author
Parents
Loading