transformers
Fix exploitable regexes in Nougat and GPTSan/GPTJNeoXJapanese
#36121
Merged

Commits
  • Fix potential regex catastrophic backtracking in NougatTokenizerFast
    Rocketknight1 committed 1 year ago
  • Try another regex
    Rocketknight1 committed 1 year ago
  • Trying deepseek's answer
    Rocketknight1 committed 1 year ago
  • Start with a simplification
    Rocketknight1 committed 1 year ago
  • Another simplification
    Rocketknight1 committed 1 year ago
  • Just rewrite the whole function myself
    Rocketknight1 committed 1 year ago
  • Fix gptneox and gptsan
    Rocketknight1 committed 1 year ago
  • Simplify the regex even further
    Rocketknight1 committed 1 year ago
  • Tighten up the price regex a little
    Rocketknight1 committed 1 year ago
  • Add possessive version of the regex
    Rocketknight1 committed 1 year ago
  • Fix regex
    Rocketknight1 committed 1 year ago
  • Much cleaner regexes
    Rocketknight1 committed 1 year ago
Loading