transformers
Fix exploitable regexes in Nougat and GPTSan/GPTJNeoXJapanese
#36121
Merged
Overview
Commits
12
Changes
View On GitHub

Fix exploitable regexes in Nougat and GPTSan/GPTJNeoXJapanese #36121

Rocketknight1 merged 12 commits into main from fix-nougat-regex
Rocketknight1
HuggingFaceDocBuilderDev
Rocketknight1 Rocketknight1 force pushed from 949dde28 to 75f90bb2 1 year ago
Rocketknight1 Rocketknight1 marked this pull request as ready for review 1 year ago
Rocketknight1 Rocketknight1 changed the title Fix potential regex catastrophic backtracking in NougatTokenizerFast Fix exploitable regexes in Nougat and GPTSan/GPTJNeoXJapanese 1 year ago
Rocketknight1
Rocketknight1
Rocketknight1
Rocketknight1
Rocketknight1
Rocketknight1
openhands-agent Fix potential regex catastrophic backtracking in NougatTokenizerFast
17f8eaf0
Rocketknight1 Try another regex
662dc140
Rocketknight1 Trying deepseek's answer
2d26be35
Rocketknight1 Start with a simplification
a1a9c962
Rocketknight1 Another simplification
a6a8c7eb
Rocketknight1 Just rewrite the whole function myself
f018df0a
Rocketknight1 Fix gptneox and gptsan
2e4e1e72
Rocketknight1 Simplify the regex even further
2143d1cf
Rocketknight1 Tighten up the price regex a little
8c2d71a1
Rocketknight1 Rocketknight1 force pushed from 404b72d8 to 8c2d71a1 1 year ago
Cyrilvallez
McPatate
McPatate commented on 2025-02-18
Rocketknight1 Add possessive version of the regex
80c265c9
Rocketknight1 Fix regex
7e836fd6
Rocketknight1 Much cleaner regexes
86a86962
Rocketknight1
Cyrilvallez
Cyrilvallez approved these changes on 2025-02-21
Rocketknight1 Rocketknight1 merged 92c5ca9d into main 1 year ago
Rocketknight1 Rocketknight1 deleted the fix-nougat-regex branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum