openvino_tokenizers
[EXPERIMENT][WIP] fix(VocabDecoderStep): avoid zero-dim Const when skip_special_tokens=False
#677

Open

[EXPERIMENT][WIP] fix(VocabDecoderStep): avoid zero-dim Const when skip_special_tokens=False #677

mlukasze wants to merge 1 commit into openvinotoolkit:master from mlukasze:fix/skip-special-tokens-zero-dim-crash

fix(VocabDecoderStep): avoid zero-dim Const when skip_special_tokens=…

b9ad7c3f

github-actions added tokenizers_py

github-actions added tokenizers_test

Reviewers

No reviews

Assignees

No one assigned

Labels

tokenizers_py tokenizers_test

Milestone

No milestone