Intermittent ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskSkip TEST-UNEXPECTED-FAIL
Categories
(Testing :: XPCShell Harness, defect, P5)
Tracking
(firefox71 affected)
| Tracking | Status | |
|---|---|---|
| firefox71 | --- | affected |
People
(Reporter: intermittent-bug-filer, Unassigned)
References
Details
(Keywords: intermittent-failure, Whiteboard: [stockwell unknown])
Attachments
(1 file)
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 41•6 years ago
|
||
This is an intermittent failure in selftest.py's testAddTaskSkip on windows2012-64/debug|asan. A very similar failure pattern is seen in some other selftest.py tests, always on Windows.
Comment 43•6 years ago
|
||
Needs work based on duplicate, and see-also's.
I have not been able to reproduce on try and do not have a clear plan.
Comment 44•6 years ago
|
||
selftest.py runs xpcshell with a timeout of 15 seconds -- much less than the timeout used in the xpcshell tests task. Most (all?) of the failures here are 15 second timeouts, and occur on asan and debug but not opt. I will try increasing the selftest.py timeout, hoping that the test just needs a little more time to complete.
Comment 45•6 years ago
|
||
Increase the selftest.py timeout from 15 to 30 seconds in hopes of avoiding
intermittent xpcshell timeouts seen only in selftest on slower platforms.
Comment 46•6 years ago
|
||
Comment 47•6 years ago
|
||
| bugherder | ||
Comment 48•6 years ago
|
||
That didn't work:
[task 2019-10-11T05:26:47.977Z] 05:26:47 INFO - check> E SUITE-START | Running 1 tests
[task 2019-10-11T05:26:47.977Z] 05:26:47 INFO - check> E profile dir is c:\users\task_1570758064\appdata\local\temp\xpcshell\xpcshellprofile
[task 2019-10-11T05:26:47.977Z] 05:26:47 INFO - check> E TEST-START | test_tasks_skip.js
[task 2019-10-11T05:26:47.977Z] 05:26:47 INFO - check> E TEST-UNEXPECTED-TIMEOUT | test_tasks_skip.js | Test timed out
[task 2019-10-11T05:26:47.977Z] 05:26:47 INFO - check> E TEST-INFO took 30000ms
[task 2019-10-11T05:26:47.978Z] 05:26:47 INFO - check> E xpcshell return code: 1
Updated•6 years ago
|
| Comment hidden (Intermittent Failures Robot) |
Comment 50•6 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.
Comment 51•6 years ago
|
||
Yeah, okay, we can try that. I think the increase in timeout lessened the severity of this type of failure. Comment 48 is the only known counter-example.
Comment 52•6 years ago
|
||
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=274763270&repo=autoland&lineNumber=47035
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Updated•6 years ago
|
Comment 56•6 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.
Comment 57•6 years ago
|
||
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=286287250&repo=autoland&lineNumber=118549
[task 2020-01-24T05:47:35.025Z] 05:47:35 INFO - check> z:\build\build\src\testing\xpcshell\selftest.py
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> ============================= test session starts =============================
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> platform win32 -- Python 2.7.15, pytest-3.6.2, py-1.5.4, pluggy-0.6.0 -- z:\build\build\src\obj-firefox_virtualenvs\obj-firefox-sNC2NmI7-2.7\Scripts\python.exe
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> rootdir: z:\build\build\src, inifile: z:\build\build\src\config\mozunit\mozunit\pytest.ini
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> collecting ... collected 56 items
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check>
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskRunNextTest PASSED
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskSkip TEST-UNEXPECTED-FAIL
[task 2020-01-24T05:47:35.026Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskSkipAll PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskStackTrace PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskTestFailureInside PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskTestMultiple PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskTestRejected PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTaskTestSingle PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTestFailing PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTestSimple PASSED
[task 2020-01-24T05:47:35.027Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTestUncaughtRejection PASSED
[task 2020-01-24T05:47:35.028Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAddTestUncaughtRejectionJSM PASSED
[task 2020-01-24T05:47:35.028Z] 05:47:35 INFO - check> ..\testing\xpcshell\selftest.py::XPCShellTestsTests::testAssertStack <- c:\mozilla-build\python\Lib\unittest\case.py SKIPPED
| Comment hidden (Intermittent Failures Robot) |
Comment 59•6 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.
Comment 60•6 years ago
|
||
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=298890240&repo=mozilla-esr68&lineNumber=42468
| Comment hidden (Intermittent Failures Robot) |
Comment 62•6 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.
Description
•