PR #37342 [vlm] adjust max length for special tokens

[vlm] adjust max length for special tokens #37342

zucchini-nlp merged 13 commits into huggingface:main from zucchini-nlp:vlm-tokenizers-truncation

update

9b526004

github-actions marked this pull request as draft 1 year ago

zucchini-nlp marked this pull request as ready for review 1 year ago

zucchini-nlp requested a review from

qubvel 1 year ago

qubvel commented on 2025-04-07

apply suggestion

7f54eeb4

merge main

316de37f

fix tests for main branch

d9eb2f0a

zucchini-nlp requested a review from

qubvel 1 year ago

remove unused logger

0def284d

add special tokens in tests

4f43ea20

nit

710b90cc

fix more tests

9e978b6a

qubvel approved these changes on 2025-04-14

fix test

30201244

pg also

c5b38e16

Merge branch 'main' into vlm-tokenizers-truncation

43384e66

Merge branch 'main' into vlm-tokenizers-truncation

51ae0b15

Merge branch 'main' into vlm-tokenizers-truncation

2c117d01

zucchini-nlp merged 32eca719 into main 1 year ago

Reviewers

qubvel

Assignees

No one assigned

Labels

None yet

Milestone

No milestone