transformers
fb3b22c3 - LlamaTokenizer should be picklable (#24681)

Commit

2 years ago

LlamaTokenizer should be picklable (#24681) * LlamaTokenizer should be picklable * make fixup

References

Author

icyblade

Parents