llama.cpp
906cff55 - py : handle byte tokens in `get_token_type` (#5341)

Commit

1 year ago

py : handle byte tokens in `get_token_type` (#5341) * py : handle byte tokens in `get_token_type` * py : fix empty bytes arg

References

Author

ggerganov

Parents