openvino_tokenizers
fb0157c3 - Гse PCRE2 fallback for RegexNormalization'

Commit
1 year ago
Гse PCRE2 fallback for RegexNormalization' * add pcre2 * use string with length instead of ZERO_TERMINATION * add Licence to thirt party * set m_search_pattern_re to nullptr if PCRE2 is used * remove unnecessary const char* * fix typo in m_replace_pattern * Update Del Control Chars Regex * Update Pass Rate * fix win build * revert added_tests in conftest.py * revert Readme & pass rates * update README & pass_rates * do not log errors * add comment on malloc --------- Co-authored-by: Artur Paniukov <chgk1101@gmail.com>
Author
Parents
Loading