Created attachment 640962 [details] [diff] [review]
Comment on attachment 640962 [details] [diff] [review]
r+, provided that you fold in the Tokenizer.java patch I'll attach shortly.
Created attachment 641841 [details] [diff] [review]
Corresponding Tokenizer.java diff
Here's the patch to be folded in.
Pushed with Tokenizer.java patch: https://hg.mozilla.org/integration/mozilla-inbound/rev/5d204299aa38