llama.cpp
ded2ad5b - py : handle byte tokens in `get_token_type`

Commit

1 year ago

py : handle byte tokens in `get_token_type`

References

#5341 - py : handle byte tokens in `get_token_type`

Author

ggerganov

ggerganov

Parents

Loading