llama.cpp
9e70cc03
- Add test for MPT tokenization (#3728)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Add test for MPT tokenization (#3728) * Add test for MPT tokenization * Revert code motion * Remove unnecessary restriction in test case * Clarify logic in conversion
References
#3728 - Add test for MPT tokenization
Author
goerch
Parents
5a42a5f8
Loading