transformers
983c484f - add getstate and setstate to XLMRobertaTokenizer

Commit

5 years ago

add __getstate__ and __setstate__ to XLMRobertaTokenizer

References

#2414 - Serializing XLMRobertaTokenizer

Author

brandenchan

brandenchan

Committer

LysandreJik

LysandreJik

Parents

Loading