openvinotoolkit/openvino_tokenizers

Pull Requests Commits

Bump product version 2025.0.1 (#426)

akladiev committed 349 days ago

Verified 4d3e9b65

[CI] Introduced GHA Overall_Status job (#406) (#408)

mryzhov committed 1 year ago

Verified 65e150ed

[MERGE][2025.0][GHA] Use OV provider on macOS (#407)

mryzhov committed 1 year ago

Verified d8cd17c5

Replace openvino.runtime imports with openvino (#379)

helena-intel committed 1 year ago

Verified 2b242022

Revert "Revert "Revert "Use opset15 version of Str Pack/Unpack (#351)" (#374)…" (#383)

rkazants committed 1 year ago

Verified afaa5217

Revert "Revert "Use opset15 version of Str Pack/Unpack (#351)" (#374)" (#381)

pavel-esir committed 1 year ago

Verified 2e59c961

GHA: use 2025.0.0rc1 (#377)

ilya-lavrenov committed 1 year ago

Verified 2a595797

Revert "Use opset15 version of Str Pack/Unpack (#351)" (#374)

apaniukov committed 1 year ago

Verified e8da805a

Write Detailed Version To XML (#372)

apaniukov committed 1 year ago

Verified 7f2ac4f9

Use opset15 version of Str Pack/Unpack (#351)

pavel-esir committed 1 year ago

Verified ac5c3978

2025 Copyright year update (#370)

jacekpawlak committed 1 year ago

Verified 708712d8

Wordpiece Detokenizer Support (#369)

apaniukov committed 1 year ago

Verified 378e393d

Update Bandit Flags (#368)

apaniukov committed 1 year ago

Verified 80fb404a

Bump hendrikmuhs/ccache-action from 1.2.14 to 1.2.16 (#366)

dependabot[bot] committed 1 year ago

Verified ef07c3dc

Add information about full Tokenizers version (#365)

ilya-lavrenov committed 1 year ago

Verified 3ecaa1c3

Fixed installation paths (#363)

ilya-lavrenov committed 1 year ago

Verified 21d93f4c

Bump actions/upload-artifact from 4.5.0 to 4.6.0 (#364)

dependabot[bot] committed 1 year ago

Verified 7c27d88b

Add Tests For WordLevel Tokenizer (#360)

apaniukov committed 1 year ago

Verified d5f0abf8

Bump py-build-cmake from 0.3.3 to 0.3.4 (#358)

dependabot[bot] committed 1 year ago

Verified bf3c15d0

Support BART-G2P Tokenizer (#359)

apaniukov committed 1 year ago

Verified cd9fb9b7

Fix Issue With Added Tokens (#357)

apaniukov committed 1 year ago

Verified 447615ef

[JS] Update openvino-tokenizers-node package version to 2024.6.0-preview (#355)

vishniakov-nikolai committed 1 year ago

Verified 838e185e

Support GLM Edge and ModernBERT (#356)

apaniukov committed 1 year ago

Verified 07ea6315

Bump actions/upload-artifact from 4.4.3 to 4.5.0 (#354)

dependabot[bot] committed 1 year ago

Verified df5420cb

Fix set tensor name for `attention_mask` (#352)

praasz committed 1 year ago

Verified bcfd3eda

set python_tag (#350)

mryzhov committed 1 year ago

Verified 1da0d2c7

replace _get_node_factory_opset1 usage with _get_factory (#349)

pavel-esir committed 1 year ago

Verified 78946fa8

print debug errors only if ENV VAR is set (#334) (#348)

pavel-esir committed 1 year ago

Verified 428fdb23

Bump py-build-cmake from 0.3.2 to 0.3.3 (#347)

dependabot[bot] committed 1 year ago

Verified 6c170a90

Improvements for build (#346)

ilya-lavrenov committed 1 year ago

Verified ece19659

Older