Closed Bug 1546922 Opened 5 years ago Closed 5 years ago

Perma Tier 2 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jittest-chunked] TEST-UNEXPECTED-FAIL

Categories

(Testing :: General, defect, P5)

Product:
Testing
Component:
General
Version:
Version 3
Type:
defect

Tracking

(firefox-esr60 unaffected, firefox66 unaffected, firefox67 unaffected, firefox68 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla68
Tracking Flags:
Tracking Status
firefox-esr60 --- unaffected
firefox66 --- unaffected
firefox67 --- unaffected
firefox68 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: gbrown)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Bug 1546922 - Update tryselect unit test name for android jittest; r=bc
47 bytes, text/x-phabricator-request
Details | Review

#[markdown(off)]
Filed by: btara [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=242533469&repo=mozilla-central

https://queue.taskcluster.net/v1/task/TfRwSSGzRKi97XbUEtTAnw/runs/0/artifacts/public/logs/live_backing.log

[task 2019-04-25T09:56:02.303Z] 1:03.23 tools/tryselect/test/test_fuzzy.py::test_paths PASSED
[task 2019-04-25T09:56:02.304Z] 1:03.23
[task 2019-04-25T09:56:02.304Z] 1:03.23 ========================== 1 passed in 38.96 seconds ===========================
[task 2019-04-25T09:56:14.982Z] 1:15.91 /builds/worker/checkouts/gecko/tools/tryselect/test/test_mozharness_integration.py
[task 2019-04-25T09:56:14.982Z] 1:15.91 ============================= test session starts ==============================
[task 2019-04-25T09:56:14.982Z] 1:15.91 platform linux2 -- Python 2.7.12, pytest-3.6.2, py-1.5.4, pluggy-0.6.0 -- /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/gecko-QUm8IANb-2/bin/python
[task 2019-04-25T09:56:14.982Z] 1:15.91 rootdir: /builds/worker/checkouts/gecko, inifile: /builds/worker/checkouts/gecko/config/mozunit/mozunit/pytest.ini
[task 2019-04-25T09:56:14.982Z] 1:15.91 collecting ... collected 60 items
[task 2019-04-25T09:56:14.983Z] 1:15.91
[task 2019-04-25T09:56:14.983Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/cppunittest] xfail
[task 2019-04-25T09:56:14.983Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/gtest] xfail
[task 2019-04-25T09:56:14.984Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest] xfail
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest-chunked] xfail
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest1] xfail
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest2] xfail
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-a11y] PASSED
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome] PASSED
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-chunked] PASSED
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-clipboard] PASSED
[task 2019-04-25T09:56:14.985Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-coverage] PASSED
[task 2019-04-25T09:56:14.986Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-instrumentation] xfail
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-screenshots] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome-chunked] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome-clipboard] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome-gpu] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome-chunked] PASSED
[task 2019-04-25T09:56:14.987Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome-coverage] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-media] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-chunked] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-chunked-coverage] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-clipboard] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-gpu] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-valgrind-plain] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl1-core] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl1-ext] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-core] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-deqp] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-ext] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/crashtest] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jsreftest] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest-no-accel] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/xpcshell] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/xpcshell-coverage] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome-webreplay] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest-gpu] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/cppunittest] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/crashtest] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/geckoview-junit] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/gtest] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jittest-chunked] TEST-UNEXPECTED-FAIL
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jsreftest] xfail
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/marionette] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-chrome] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-media] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-plain] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-plain-clipboard] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-plain-gpu] PASSED
[task 2019-04-25T09:56:14.988Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl1-core] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl1-ext] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-core] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-deqp] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-ext] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/reftest] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/robocop] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/xpcshell] PASSED
[task 2019-04-25T09:56:14.989Z] 1:15.91
[task 2019-04-25T09:56:14.989Z] 1:15.91 =================================== FAILURES ===================================
[task 2019-04-25T09:56:14.989Z] 1:15.91 ____________ test_suites[android_emulator_unittest/jittest-chunked] ____________
[task 2019-04-25T09:56:14.990Z] 1:15.91
[task 2019-04-25T09:56:14.990Z] 1:15.91 item = ('android_emulator_unittest', ('jittest-chunked',))
[task 2019-04-25T09:56:14.990Z] 1:15.91 patch_resolver = <function inner at 0x7fc4913e6488>
[task 2019-04-25T09:56:14.990Z] 1:15.91 all_suites = [{'flavor': 'mochitest', 'srcdir_relpath': 'test'}, {'flavor': 'firefox-ui-functional', 'srcdir_relpath': 'test'}, {'f...lpath': 'test'}, {'flavor': 'marionette', 'srcdir_relpath': 'test'}, {'flavor': 'a11y', 'srcdir_relpath': 'test'}, ...]
[task 2019-04-25T09:56:14.990Z] 1:15.91
[task 2019-04-25T09:56:14.990Z] 1:15.91 @pytest.mark.parametrize('item', generate_suites(), ids=idfn)
[task 2019-04-25T09:56:14.990Z] 1:15.91 def test_suites(item, patch_resolver, all_suites):
[task 2019-04-25T09:56:14.990Z] 1:15.91 """An integration test to make sure the suites returned by
[task 2019-04-25T09:56:14.990Z] 1:15.91 `tasks.resolve_tests_by_suite` match up with the names defined in
[task 2019-04-25T09:56:14.991Z] 1:15.91 mozharness.
[task 2019-04-25T09:56:14.991Z] 1:15.91 """
[task 2019-04-25T09:56:14.991Z] 1:15.91 patch_resolver([], all_suites)
[task 2019-04-25T09:56:14.991Z] 1:15.91 suites = resolve_tests_by_suite(['test'])
[task 2019-04-25T09:56:14.991Z] 1:15.91 os.environ['MOZHARNESS_TEST_PATHS'] = json.dumps(suites)
[task 2019-04-25T09:56:14.991Z] 1:15.91
[task 2019-04-25T09:56:14.991Z] 1:15.92 name, suite = item
[task 2019-04-25T09:56:14.991Z] 1:15.92 func = get_mozharness_test_paths(name)
[task 2019-04-25T09:56:14.992Z] 1:15.92 > assert func(*suite)
[task 2019-04-25T09:56:14.992Z] 1:15.92 E AssertionError: assert None
[task 2019-04-25T09:56:14.992Z] 1:15.92 E + where None = <bound method AndroidEmulatorTest._get_mozharness_test_paths of <scripts.android_emulator_unittest.AndroidEmulatorTest object at 0x7fc48f869710>>(*('jittest-chunked',))
[task 2019-04-25T09:56:14.992Z] 1:15.92
[task 2019-04-25T09:56:14.992Z] 1:15.92 tools/tryselect/test/test_mozharness_integration.py:142: AssertionError
[task 2019-04-25T09:56:14.992Z] 1:15.92 ----------------------------- Captured stderr call -----------------------------
[task 2019-04-25T09:56:14.992Z] 1:15.92 09:56:03 INFO - ConsoleLogger online at 20190425 09:56:03Z in /builds/worker/checkouts/gecko
[task 2019-04-25T09:56:14.992Z] 1:15.92 09:56:03 INFO - Run as /builds/worker/checkouts/gecko/tools/tryselect/test/test_mozharness_integration.py
[task 2019-04-25T09:56:14.992Z] 1:15.92 ------------------------------ Captured log call -------------------------------
[task 2019-04-25T09:56:14.993Z] 1:15.92 log.py 589 INFO ConsoleLogger online at 20190425 09:56:03Z in /builds/worker/checkouts/gecko
[task 2019-04-25T09:56:14.993Z] 1:15.92 log.py 589 INFO Run as /builds/worker/checkouts/gecko/tools/tryselect/test/test_mozharness_integration.py
[task 2019-04-25T09:56:14.993Z] 1:15.92 =============================== warnings summary ===============================
[task 2019-04-25T09:56:14.993Z] 1:15.92 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/cppunittest]
[task 2019-04-25T09:56:14.993Z] 1:15.92 /builds/worker/checkouts/gecko/build/mach_bootstrap.py:392: RuntimeWarning: Parent module 'scripts' not found while handling absolute import
[task 2019-04-25T09:56:14.993Z] 1:15.92 module = self._original_import(name, globals, locals, fromlist, level)
[task 2019-04-25T09:56:14.993Z] 1:15.92
[task 2019-04-25T09:56:14.993Z] 1:15.92 -- Docs: http://doc.pytest.org/en/latest/warnings.html

Flags: needinfo?(gbrown)
Regressed by: 1492695
Summary: Intermittent Tier 2 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jittest-chunked] TEST-UNEXPECTED-FAIL → Perma Tier 2 1:15.91 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jittest-chunked] TEST-UNEXPECTED-FAIL
Assignee: nobody → gbrown
Flags: needinfo?(gbrown)
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d1240d47e791
Update tryselect unit test name for android jittest; r=bc

https://hg.mozilla.org/mozilla-central/rev/d1240d47e791

Status: NEW → RESOLVED
Closed: 5 years ago
status-firefox68: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: