transformers.js
1a9964fb - Use ungated version of mistral tokenizer (#718)

Comment changes are shownComment changes are hidden
Commit
1 year ago
Use ungated version of mistral tokenizer (#718)
Author
Parents
  • src
    • File
      tokenizers.js
  • tests
    • File
      generate_tests.py
    • File
      tokenizers.test.js
Loading