convert.py : BPE fixes (#2938)

Commit

2 years ago

convert.py : BPE fixes (#2938) * convert.py: BPE fixes? * Remove unnecessary conditional in addl token error handling