openvinotoolkit/openvino_tokenizers

Pull Requests Commits

Bump product version 2025.2.1 (#517)

akladiev committed 224 days ago

Verified 00fdab40

Remove python upper limits (#513)

mryzhov committed 225 days ago

Verified 7885335c

[GGUF] Create tokenizers factory for GGUF support in OpenVINO GenAI (#494)

rkazants committed 253 days ago

Verified 85be884a

Bump ruff from 0.11.9 to 0.11.10 (#488)

dependabot[bot] committed 259 days ago

Verified 130827ab

add number_of_inputs to cli (#490)

pavel-esir committed 259 days ago

Verified 30b45bf7

Update dependabot.yml

mryzhov committed 263 days ago

Verified 5b240070

Bump ruff from 0.11.7 to 0.11.9 (#486)

dependabot[bot] committed 264 days ago

Verified 99e369bd

Update dependabot.yml

mryzhov committed 264 days ago

Verified 4c27564c

Poetry dependency management (#484)

mryzhov committed 265 days ago

Verified a4af3f3b

Bump actions/dependency-review-action from 4.7.0 to 4.7.1 (#485)

dependabot[bot] committed 265 days ago

Verified 703f0670

Replace openvino.runtime import (#482)

almilosz committed 270 days ago

Verified 0de9704c

Support Sentencepiece Chars Tokenizer (#476)

apaniukov committed 270 days ago

Verified cdb092b3

Revert "Poetry dependency management (#467)" (#483)

mryzhov committed 270 days ago

Verified 51d45a65

Poetry dependency management (#467)

mryzhov committed 270 days ago

Verified 358863af

Bump actions/dependency-review-action from 4.6.0 to 4.7.0 (#477)

dependabot[bot] committed 270 days ago

Verified e001ea77

Fix Coverity Sentencepiece (#474)

apaniukov committed 272 days ago

Verified 88058a6b

Bump actions/download-artifact from 4.2.1 to 4.3.0 (#472)

dependabot[bot] committed 284 days ago

Verified 979cba29

Bump actions/setup-python from 5.5.0 to 5.6.0 (#471)

dependabot[bot] committed 285 days ago

Verified ff055c2b

Alternative fix for JIT in PRCE2 (#470)

ilya-lavrenov committed 286 days ago

Verified 86b3f533

Ensure PCRE2 JiT is Available (#469)

apaniukov committed 286 days ago

Verified 0afc182f

Improve pair input (#455)

pavel-esir committed 291 days ago

Verified 77f7abc0

[JS} Upgrade the js package versions to the upcoming releases (#468)

Retribution98 committed 294 days ago

Verified c0771e9f

[GHA] Improving caching (#464)

mryzhov committed 301 days ago

Verified d3bb17cc

Bump py-build-cmake from 0.4.2 to 0.4.3 (#465)

dependabot[bot] committed 301 days ago

Verified 11aacf3e

Bump tar-fs from 3.0.6 to 3.0.8 in /js (#458)

dependabot[bot] committed 302 days ago

Verified 5a2b9637

Add Support For Falcon3 Tokenizer (#463)

apaniukov committed 305 days ago

Verified 7d64f280

Skip OpenVINO_DIR (#462)

apaniukov committed 305 days ago

Verified 2985c6ee

[GHA] use dev package for build (#453)

mryzhov committed 305 days ago

Verified a38e98a7

[ICU] Added crossplatform compilation flags (#461)

mryzhov committed 306 days ago

Verified 2869dc4b

Check Binary Compatibility Before Patching (#459)

apaniukov committed 306 days ago

Verified 65c99697

Older