transformers
1efb21c7 - Explicitly check if token ID's are None in TFBertTokenizer constructor (#28824)

Commit

2 years ago

Explicitly check if token ID's are None in TFBertTokenizer constructor (#28824) Add an explicit none-check, since token ids can be 0

References

Author

skumar951

Parents