1885395 - Optimizing webidl lexing step

Status: NEW

(Core :: DOM: Bindings (WebIDL), task)

Description

[[:sergesanspaille]]

It takes more than one second just to do the lexing part, there's probably some optimization opportunities there

Comment 1

[[:sergesanspaille]]

Attachment: Bug 1885395 - speedup webidl lexer r=ahochheiden!

• use non capturing parenthesis for the regular expression
• rely on int(val, base=0) to detect base instead of doing it by hand
• use the lex literals magic entry to speedup token processing (and
  for easier grammar maintenance)

This saves roughly 100ms during lexing, which is 10% of its actual time.

Depends on D204670