Closed Bug 1713197 Opened 3 years ago Closed 3 years ago

Perma Python3 0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_pass[plain-selftest] TEST-UNEXPECTED-FAIL

Categories

(Testing :: Mochitest, defect, P5)

Product:
Testing
Component:
Mochitest
Type:
defect

Tracking

(firefox-esr78 unaffected, firefox88 unaffected, firefox89 unaffected, firefox90 fixed)

Status:
RESOLVED FIXED
Milestone:
90 Branch
Tracking Flags:
Tracking Status
firefox-esr78 --- unaffected
firefox88 --- unaffected
firefox89 --- unaffected
firefox90 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: jmaher)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Bug 1713197 - fix mochitest self tests to use proper mozinfo. r=ahal
48 bytes, text/x-phabricator-request
Details | Review

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=340986035&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TczEybYUTyGZ3YkiEIBmUA/runs/0/artifacts/public/logs/live_backing.log

[task 2021-05-27T18:03:55.434Z]  0:29.39 /builds/worker/checkouts/gecko/testing/mochitest/tests/python/test_mochitest_integration.py
[task 2021-05-27T18:03:55.434Z]  0:29.39 ============================= test session starts ==============================
[task 2021-05-27T18:03:55.434Z]  0:29.39 platform linux -- Python 3.6.9, pytest-3.6.2, py-1.10.0, pluggy-0.6.0 -- /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/python-test/bin/python
[task 2021-05-27T18:03:55.434Z]  0:29.39 rootdir: /builds/worker/checkouts/gecko, inifile: /builds/worker/checkouts/gecko/config/mozunit/mozunit/pytest.ini
[task 2021-05-27T18:03:55.434Z]  0:29.39 collecting ... collected 15 items
[task 2021-05-27T18:03:55.434Z]  0:29.39 
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_pass[plain-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_pass[plain] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_pass[browser-chrome-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_pass[browser-chrome] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_fail[plain-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_fail[plain] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_fail[browser-chrome-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_fail[browser-chrome] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_crash[plain-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_crash[plain] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_crash[browser-chrome-selftest] TEST-UNEXPECTED-FAIL
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_crash[browser-chrome] PASSED
[task 2021-05-27T18:03:55.434Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_asan[plain] SKIPPED
[task 2021-05-27T18:03:55.435Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_assertion[plain] SKIPPED
[task 2021-05-27T18:03:55.435Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py::test_output_leak[plain] SKIPPED
[task 2021-05-27T18:03:55.435Z]  0:29.39 
[task 2021-05-27T18:03:55.435Z]  0:29.39 =================================== FAILURES ===================================
[task 2021-05-27T18:03:55.435Z]  0:29.39 _______________________ test_output_pass[plain-selftest] _______________________
[task 2021-05-27T18:03:55.435Z]  0:29.39 
[task 2021-05-27T18:03:55.435Z]  0:29.39 flavor = 'plain', runFailures = 'selftest'
[task 2021-05-27T18:03:55.435Z]  0:29.39 runtests = <function runtests.<locals>.inner at 0x7f9f6f4bc488>
[task 2021-05-27T18:03:55.435Z]  0:29.39 test_name = <function test_name.<locals>.inner at 0x7f9f6f4bc598>
[task 2021-05-27T18:03:55.435Z]  0:29.39 
[task 2021-05-27T18:03:55.435Z]  0:29.39     @pytest.mark.parametrize("runFailures", ["selftest", ""])
[task 2021-05-27T18:03:55.435Z]  0:29.39     @pytest.mark.parametrize("flavor", ["plain", "browser-chrome"])
[task 2021-05-27T18:03:55.435Z]  0:29.39     def test_output_pass(flavor, runFailures, runtests, test_name):
[task 2021-05-27T18:03:55.435Z]  0:29.39         extra_opts = {}
[task 2021-05-27T18:03:55.435Z]  0:29.39         results = {
[task 2021-05-27T18:03:55.435Z]  0:29.39             "status": 1 if runFailures else 0,
[task 2021-05-27T18:03:55.435Z]  0:29.39             "tbpl_status": TBPL_WARNING if runFailures else TBPL_SUCCESS,
[task 2021-05-27T18:03:55.435Z]  0:29.39             "log_level": (INFO, WARNING),
[task 2021-05-27T18:03:55.435Z]  0:29.39             "lines": 2 if runFailures else 1,
[task 2021-05-27T18:03:55.435Z]  0:29.39             "line_status": "PASS",
[task 2021-05-27T18:03:55.435Z]  0:29.39         }
[task 2021-05-27T18:03:55.435Z]  0:29.39         if runFailures:
[task 2021-05-27T18:03:55.435Z]  0:29.39             extra_opts["runFailures"] = runFailures
[task 2021-05-27T18:03:55.435Z]  0:29.39             extra_opts["crashAsPass"] = True
[task 2021-05-27T18:03:55.436Z]  0:29.39             extra_opts["timeoutAsPass"] = True
[task 2021-05-27T18:03:55.436Z]  0:29.39 
[task 2021-05-27T18:03:55.436Z]  0:29.39         status, lines = runtests(test_name("pass"), **extra_opts)
[task 2021-05-27T18:03:55.436Z]  0:29.39 >       assert status == results["status"]
[task 2021-05-27T18:03:55.436Z]  0:29.39 E       assert 0 == 1
[task 2021-05-27T18:03:55.436Z]  0:29.39 
[task 2021-05-27T18:03:55.436Z]  0:29.39 testing/mochitest/tests/python/test_mochitest_integration.py:52: AssertionError
[task 2021-05-27T18:03:55.436Z]  0:29.39 ----------------------------- Captured stdout call -----------------------------
[task 2021-05-27T18:03:55.436Z]  0:29.39 Checking for ssltunnel processes...
[task 2021-05-27T18:03:55.436Z]  0:29.39 Checking for xpcshell processes...
[task 2021-05-27T18:03:55.436Z]  0:29.39 No tests were found for flavor 'plain' and the following manifest filters:
[task 2021-05-27T18:03:55.436Z]  0:29.39 subsuite(name=None), failures(selftest)
[task 2021-05-27T18:03:55.436Z]  0:29.39 
[task 2021-05-27T18:03:55.436Z]  0:29.39 Make sure the test paths (if any) are spelt correctly and the corresponding
[task 2021-05-27T18:03:55.436Z]  0:29.39 --flavor and --subsuite are being used. See `mach mochitest --help` for a
[task 2021-05-27T18:03:55.436Z]  0:29.39 list of valid flavors.
Flags: needinfo?(jmaher)

on it, hoping to have a fix landed today

Flags: needinfo?(jmaher)
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/3a0229b0a7af
fix mochitest self tests to use proper mozinfo. r=ahal

Set release status flags based on info from the regressing bug 1712968

status-firefox88: --- → unaffected
status-firefox89: --- → unaffected
status-firefox90: --- → affected
status-firefox-esr78: --- → unaffected

https://hg.mozilla.org/mozilla-central/rev/3a0229b0a7af

Status: ASSIGNED → RESOLVED
Closed: 3 years ago
status-firefox90: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 90 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: