transformers
[MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field
#47646

Merged

[MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field #47646

ArthurZucker merged 2 commits into huggingface:main from juliendenize:juliendenize/oss-123-transformers-stop-depending-on-tokenizedtext-from-mistral

Stop relying on mistral-common's Tokenized.text and decode tokens exp…

0edc4a1f

juliendenize force pushed from 5d3aef90 to 0edc4a1f 19 days ago

juliendenize changed the title ~~Stop relying on mistral-common's Tokenized.text field~~ [MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field 19 days ago

juliendenize marked this pull request as ready for review 19 days ago

github-actions requested a review from

molbap 19 days ago

github-actions requested a review from

ydshieh 19 days ago

joa-stdn commented on 2026-07-30

joa-stdn approved these changes on 2026-07-30

itazap approved these changes on 2026-07-31

Merge branch 'main' into juliendenize/oss-123-transformers-stop-depen…

f17d0787

ArthurZucker approved these changes on 2026-08-10

ArthurZucker merged 81df408a into main 8 days ago

Reviewers

ArthurZucker

itazap

joa-stdn

molbap

ydshieh

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field #47646 Merged

[MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field #47646

transformers
[MistralCommonBackend] Stop relying on mistral-common's Tokenized.text field
#47646

Merged