687977 - JavaScript errors undetected during test run

Status: NEW

(Testing :: Reftest, defect)

Description

[Joey Armstrong [:joey]]

A nop try job was submitted to trigger these log entries.  My sample was modifying rules.mk and inserting a bogus makefile target.

There is a long stream of "JavaScript errors" reported and most of the testing blocks they are reported reported success.  Log parsing to determine status is far from reliable, maybe the talos suite could use exit status to report a failure in this case:

LOG: try_fedora64-debug_test-crashtest-build678.txt.gz
LOG try_fedora-debug_test-crashtest-build406.txt.gz
LOG try_leopard-o-debug_test-crashtest-build654.txt.gz
LOG try_snowleopard-debug_test-crashtest-build661.txt.gz
LOG try_win7-debug_test-crashtest-build592.txt.gz
LOG try_xp-debug_test-crashtest-build722.txt.gz


REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html
JavaScript error: file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html, line 11: xmlElem is null
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/149320-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Index or size is negative or greater than the allowed amount"  code: "1" ns
result: "0x80530001 (NS_ERROR_DOM_INDEX_SIZE_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crash
tests/149320-1.html Line: 10"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/149320-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Operation is not supported"  code: "9" nsresult: "0x80530009 (NS_ERROR_DOM_
NOT_SUPPORTED_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html Line: 4"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Node was not found"  code: "8" nsresult: "0x80530008 (NS_ERROR_DOM_NOT_FOUN
D_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html Line: 8"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml
JavaScript error: , line 0: uncaught exception: [Exception... "Node was not found"  code: "8" nsresult: "0x80530008 (NS_ERROR_DOM_NOT_FOUN
D_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml Line: 11"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml | (LOAD ONLY)

Comment 1

[[e-mail] (:bhearsum)]

I think this probably belongs in the harness...what do you think, Ted?

Comment 2

[(not currently active) Ted Mielczarek]

I agree.