llama.cpp
9e70cc03 - Add test for MPT tokenization (#3728)

Commit
1 year ago
Add test for MPT tokenization (#3728) * Add test for MPT tokenization * Revert code motion * Remove unnecessary restriction in test case * Clarify logic in conversion
Author
Parents
Loading