transformers
9a4521dd - Support single token decode for `CodeGenTokenizer` (#28628)

Commit

1 year ago

Support single token decode for `CodeGenTokenizer` (#28628) convert token id to list in .decode()

References

Author

cmathw

Parents