transformers
51794bf2 - [`SPM`] Patch `spm` Llama and T5 (#25656)

Commit
2 years ago
[`SPM`] Patch `spm` Llama and T5 (#25656) * hot fix * only encode with string prefix if starts with prefix * styling * add a new test * fixup
Author
Parents
Loading