transformers
d6b0b9d4 - GPT2 tokenizer should not output token type IDs (#5546)

Commit

5 years ago

GPT2 tokenizer should not output token type IDs (#5546) * GPT2 tokenizer should not output token type IDs * Same for OpenAIGPT

References

Author

LysandreJik

Parents