llama.cpp
ded2ad5b - py : handle byte tokens in `get_token_type`

Commit

2 years ago

py : handle byte tokens in `get_token_type`

References

#5341 - py : handle byte tokens in `get_token_type`

Author

ggerganov

ggerganov

Parents

Loading