ruff
Speed up identifier and keyword lexing
#29463
Merged

Commits
  • Scan ASCII identifiers with byte lookups
    charliermarsh committed 12 days ago
  • Scan identifier bytes in fixed-size batches
    charliermarsh committed 12 days ago
  • Use sixteen-byte identifier batches
    charliermarsh committed 12 days ago
  • Skip keyword slicing for long ASCII identifiers
    charliermarsh committed 12 days ago
  • Compare keyword candidates as bytes
    charliermarsh committed 12 days ago
  • Recognize Python keywords with a compact hash table
    charliermarsh committed 12 days ago
  • Simplify keyword table construction
    charliermarsh committed 12 days ago
  • Clarify identifier scanning and generate keyword tables
    charliermarsh committed 12 days ago
  • Document the lexer keyword hash tradeoff
    charliermarsh committed 12 days ago
Loading