ruff
6dade5b9 - Tokenizer: Emit only a single bogus token (#7425)

Commit
2 years ago
Tokenizer: Emit only a single bogus token (#7425) **Summary** Instead of emitting a bogus token per char, we now only emit on single last bogus token. This leads to much more concise output. **Test Plan** Updated fixtures
Author
Parents
Loading