openvino_tokenizers
[GGUF] Create tokenizers factory for GGUF support in OpenVINO GenAI
#494
Merged

[GGUF] Create tokenizers factory for GGUF support in OpenVINO GenAI #494

rkazants
rkazants [GGUF] Create tokenizers factory method
2c15530d
rkazants Clean-up implementation
82fd33ae
github-actions github-actions added tokenizers_cpp
rkazants rkazants changed the title Create tokenizers factory 2025 2 [GGUF ]Create tokenizers factory for GGUF support in OpenVINO GenAI 258 days ago
rkazants rkazants changed the title [GGUF ]Create tokenizers factory for GGUF support in OpenVINO GenAI [GGUF] Create tokenizers factory for GGUF support in OpenVINO GenAI 258 days ago
rkazants
rkazants commented on 2025-05-26
rkazants Update src/tokenizers_factory.cpp
67ab09b0
rkazants
rkazants commented on 2025-05-26
rkazants Update src/tokenizers_factory.cpp
2aca44d7
rkazants rkazants requested a review from pavel-esir pavel-esir 258 days ago
rkazants rkazants requested a review from gkrivor gkrivor 258 days ago
rkazants rkazants requested a review from andrei-kochin andrei-kochin 258 days ago
rkazants rkazants enabled auto-merge (squash) 258 days ago
pavel-esir
pavel-esir approved these changes on 2025-05-26
rkazants rkazants merged 85be884a into releases/2025/2 258 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone