Open Bug 687977 Opened 8 years ago Updated 5 years ago

JavaScript errors undetected during test run

Categories

(Testing :: Reftest, defect)

defect
Not set

Tracking

(Not tracked)

People

(Reporter: joey, Unassigned)

Details

A nop try job was submitted to trigger these log entries.  My sample was modifying rules.mk and inserting a bogus makefile target.

There is a long stream of "JavaScript errors" reported and most of the testing blocks they are reported reported success.  Log parsing to determine status is far from reliable, maybe the talos suite could use exit status to report a failure in this case:

LOG: try_fedora64-debug_test-crashtest-build678.txt.gz
LOG try_fedora-debug_test-crashtest-build406.txt.gz
LOG try_leopard-o-debug_test-crashtest-build654.txt.gz
LOG try_snowleopard-debug_test-crashtest-build661.txt.gz
LOG try_win7-debug_test-crashtest-build592.txt.gz
LOG try_xp-debug_test-crashtest-build722.txt.gz


REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html
JavaScript error: file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html, line 11: xmlElem is null
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/43040-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/149320-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Index or size is negative or greater than the allowed amount"  code: "1" ns
result: "0x80530001 (NS_ERROR_DOM_INDEX_SIZE_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crash
tests/149320-1.html Line: 10"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/149320-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Operation is not supported"  code: "9" nsresult: "0x80530009 (NS_ERROR_DOM_
NOT_SUPPORTED_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html Line: 4"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/205225-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html
JavaScript error: , line 0: uncaught exception: [Exception... "Node was not found"  code: "8" nsresult: "0x80530008 (NS_ERROR_DOM_NOT_FOUN
D_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html Line: 8"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/293388-1.html | (LOAD ONLY)

REFTEST TEST-START | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml
JavaScript error: , line 0: uncaught exception: [Exception... "Node was not found"  code: "8" nsresult: "0x80530008 (NS_ERROR_DOM_NOT_FOUN
D_ERR)"  location: "file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml Line: 11"]
REFTEST TEST-PASS | file:///home/cltbld/talos-slave/test/build/reftest/tests/content/base/crashtests/338391-1.xhtml | (LOAD ONLY)
I think this probably belongs in the harness...what do you think, Ted?
Summary: JavaScript errors undetected during talos test run → JavaScript errors undetected during test run
I agree.
Component: Release Engineering → Reftest
Product: mozilla.org → Testing
QA Contact: release → reftest
Version: other → Trunk
You need to log in before you can comment on or make changes to this bug.