transformers
remove the redundant non maintained jieba to rjieba
#40383

Merged

Commits

porting not maintained jieba to rjieba

divyanshsinghvi committed 121 days ago
Fix format

divyanshsinghvi committed 121 days ago
replaced the line with rjieba instead of removing it

divyanshsinghvi committed 121 days ago
cut_all is not included as a parameter. cut_all is a seperate function rjieba

divyanshsinghvi committed 121 days ago
rev

divyanshsinghvi committed 121 days ago
jieba remove installation

divyanshsinghvi committed 119 days ago
Trigger tests

divyanshsinghvi committed 119 days ago
Merge branch 'main' into porting_jieba_dependency_to_rjieba

ydshieh committed 118 days ago
Update tokenization_cpm.py

divyanshsinghvi committed 118 days ago
Update tokenization_cpm_fast.py

divyanshsinghvi committed 118 days ago