1365804 - Firefox built in json parser corrupts large dataset

Status: RESOLVED DUPLICATE of bug 1224071

(DevTools :: JSON Viewer, defect)

Description

[Simon Broad]

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:53.0) Gecko/20100101 Firefox/53.0
Build ID: 20170504105526

Steps to reproduce:

Requested a large amount of data from our own in-house product's API that returns the data in JSON format.
Data is valid JSON in excess of 100,000 characters, sometimes it can be slow to load.

The data has been verified as valid JSON code by 
 * using alternative browsers 
 * turning off the Firefox JSON parser (about:config -> devtools.jsonview.enabled = false)
and then verifying in multiple JSON parsers tools as valid.

Only get the problem when devtools.jsonview.enabled is set to true.

Firefox 53.0.2(32-bit) running on Windows 7


Actual results:

Firefox reported a syntax error in the JSON, several runs reported different errors, some runs were successful.
It appears the data is getting corrupted.

Error Messages seen:
 SyntaxError: JSON.parse: expected double-quoted property name at line 1 column 116982 of the JSON data
 SyntaxError: JSON.parse: expected ':' after property name in object at line 1 column 251801 of the JSON data
 SyntaxError: JSON.parse: expected ',' or '}' after property value in object at line 1 column 66588 of the JSON data

When looking into the data where the error is reported I find that on some occasions the data is truncated, but on others the format is indeed invalid.
I have observer missing double quotes, and instances where a double quote and a colon have transposed their positions.

The data is machine generated and validated in other tools, therefor the corruption appears to occur in the parser.



Expected results:

Should have displayed valid JSON data in a formatted display.

Comment 1

[Loic]

Could you provide a simple testcase to reproduce the issue.

Comment 2

[Simon Broad]

Sorry,
The data we use is sensitive and subject to privacy issues, and the API is locked down in end users sites.
I will look to the Internet of Everything to find another source of data that is readily available and repeats the issue reported.

Comment 3

[Loic]

I don't how your API works but maybe you can generate random data, just for the demo.

Comment 4

[Oriol Brufau [:Oriol]]

See bug 1224071 and bug 1327753.

Comment 5

[Oriol Brufau [:Oriol]]

This seems a duplicate of bug 1224071 and should have been fixed by bug 1367894.