PR #37342 [vlm] adjust max length for special tokens

update

zucchini-nlp committed 1 year ago

apply suggestion

zucchini-nlp committed 1 year ago

merge main

zucchini-nlp committed 1 year ago

fix tests for main branch

zucchini-nlp committed 1 year ago

remove unused logger

zucchini-nlp committed 1 year ago

add special tokens in tests

zucchini-nlp committed 1 year ago

nit

zucchini-nlp committed 1 year ago

fix more tests

zucchini-nlp committed 1 year ago

fix test

zucchini-nlp committed 1 year ago

pg also

zucchini-nlp committed 1 year ago

Merge branch 'main' into vlm-tokenizers-truncation

zucchini-nlp committed 1 year ago

Merge branch 'main' into vlm-tokenizers-truncation

zucchini-nlp committed 1 year ago

Merge branch 'main' into vlm-tokenizers-truncation

zucchini-nlp committed 1 year ago

transformers [vlm] adjust max length for special tokens #37342 Merged