1528923 - Intermittent ../testing/xpcshell/selftest.py::XPCShellTestsTests::testRandomExecution TEST-UNEXPECTED-FAIL

Status: RESOLVED DUPLICATE of bug 1527803

(Testing :: XPCShell Harness, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: aciure [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=229162547&repo=autoland

https://queue.taskcluster.net/v1/task/O3FPQJc6TOWQ-aTUDVXTsw/runs/0/artifacts/public/logs/live_backing.log

[task 2019-02-19T09:28:37.870Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testPassFail PASSED
[task 2019-02-19T09:28:37.870Z] 09:28:37 WARNING - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testRandomExecution TEST-UNEXPECTED-FAIL
[task 2019-02-19T09:28:37.870Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testReturnNonzero PASSED
[task 2019-02-19T09:28:37.870Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testSkip PASSED
[task 2019-02-19T09:28:37.870Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testSkipForAddTask PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testSkipForAddTest PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testSyntaxError PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testUncaughtRejection PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testUncaughtRejectionJSM PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testUnexpectedPass PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py::XPCShellTestsTests::testUnicodeInAssertMethods PASSED
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - =================================== FAILURES ===================================
[task 2019-02-19T09:28:37.871Z] 09:28:37 INFO - ____________________ XPCShellTestsTests.testRandomExecution ____________________
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - self = <selftest.XPCShellTestsTests testMethod=testRandomExecution>
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - def testRandomExecution(self):
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - """
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - Check that random execution doesn't break.
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - """
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - manifest = []
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - for i in range(0, 10):
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - filename = "test_pass_%d.js" % i
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - self.writeFile(filename, SIMPLE_PASSING_TEST)
[task 2019-02-19T09:28:37.872Z] 09:28:37 INFO - manifest.append(filename)
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - self.writeManifest(manifest)
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - > self.assertTestResult(True, shuffle=True)
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py:1110:
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - ../testing/xpcshell/selftest.py:527: in assertTestResult
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - """ % ("passed" if expected else "failed", self.log.getvalue()))
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - E AssertionError: Tests should have passed, log:
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - E ========
[task 2019-02-19T09:28:37.873Z] 09:28:37 INFO - E MOZ_NODE_PATH environment variable not set. Tests requiring http/2 will fail.

Comment 2

[Intermittent Failures Robot]

5 failures in 2602 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform breakdown:

• linux64-noopt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1528923&startday=2019-02-18&endday=2019-02-24&tree=all