Closed Bug 1585683 Opened 5 years ago Closed 5 years ago

Add webgpu-* mochitest suite

Categories

(Core :: Graphics: WebGPU, enhancement, P3)

Product:
Core
Component:
Graphics: WebGPU
Type:
enhancement

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla74
Tracking Flags:
Tracking Status
firefox74 --- fixed

People

(Reporter: kvark, Assigned: jgilbert)

Details

Attachments

(1 file)

Bug 1585683 - Add mochitest-webgpu jobs, add subsuite = webgpu.
47 bytes, text/x-phabricator-request
Details | Review

We need a separate mochitest suite. Current tests use webgl1-core.

Priority: -- → P3
Summary: Add webgpu-core mochitest suite → Add webgpu-* mochitest suite

It's actually not clear if this suite is needed at all, given bug 1601036

Assignee: nobody → jgilbert
Status: NEW → ASSIGNED

Here's a try run:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=f2a48731e4faf2354322c86b31aecea595365438

I think I know what to do for the try-try failures.

Pushed by jgilbert@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/33ccfb45bb3f Add mochitest-webgpu jobs, add subsuite = webgpu. r=jmaher,kvark

Backed out changeset 33ccfb45bb3f (Bug 1585683) on jgilbert's request

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&fromchange=33ccfb45bb3f91effb92fb4bcaa3c95276cc00f4&tochange=662a7ff8cde513e30768ad7890f857ddf1404b8f&selectedJob=283890378

Backout link: https://hg.mozilla.org/integration/autoland/rev/662a7ff8cde513e30768ad7890f857ddf1404b8f

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=283890378&repo=autoland&lineNumber=398

[task 2020-01-07T21:06:58.375Z] 0:30.10 platform linux2 -- Python 2.7.17, pytest-3.6.2, py-1.5.4, pluggy-0.6.0 -- /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/gecko-QUm8IANb-2/bin/python
[task 2020-01-07T21:06:58.375Z] 0:30.10 rootdir: /builds/worker/checkouts/gecko, inifile: /builds/worker/checkouts/gecko/config/mozunit/mozunit/pytest.ini
[task 2020-01-07T21:06:58.375Z] 0:30.10 collecting ... collected 51 items
[task 2020-01-07T21:06:58.376Z] 0:30.10
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/cppunittest] xfail
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/gtest] xfail
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest] xfail
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest1] xfail
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest2] xfail
[task 2020-01-07T21:06:58.376Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-a11y] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-coverage] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-browser-chrome-screenshots] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-chrome-gpu] PASSED
[task 2020-01-07T21:06:58.377Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome-coverage] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-media] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-coverage] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-plain-gpu] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-remote] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-valgrind-plain] xfail
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl1-core] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl1-ext] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-core] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-deqp] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgl2-ext] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-webgpu] TEST-UNEXPECTED-FAIL
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/crashtest] PASSED
[task 2020-01-07T21:06:58.378Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jsreftest] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest] PASSED
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest-no-accel] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/xpcshell] PASSED
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/xpcshell-coverage] PASSED
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/jittest-chunked] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/mochitest-devtools-chrome-webreplay] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[desktop_unittest/reftest-gpu] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/cppunittest] xfail
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/crashtest] PASSED
[task 2020-01-07T21:06:58.379Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/geckoview-junit] xfail
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/gtest] xfail
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jittest] xfail
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/jsreftest] xfail
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-media] PASSED
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-plain] PASSED
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-plain-gpu] PASSED
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl1-core] PASSED
[task 2020-01-07T21:06:58.380Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl1-ext] PASSED
[task 2020-01-07T21:06:58.383Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-core] PASSED
[task 2020-01-07T21:06:58.383Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-deqp] PASSED
[task 2020-01-07T21:06:58.383Z] 0:30.10 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgl2-ext] PASSED
[task 2020-01-07T21:06:58.384Z] 0:30.11 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/mochitest-webgpu] TEST-UNEXPECTED-FAIL
[task 2020-01-07T21:06:58.384Z] 0:30.11 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/reftest] PASSED
[task 2020-01-07T21:06:58.384Z] 0:30.11 tools/tryselect/test/test_mozharness_integration.py::test_suites[android_emulator_unittest/xpcshell] PASSED
[task 2020-01-07T21:06:58.384Z] 0:30.11
[task 2020-01-07T21:06:58.384Z] 0:30.11 =================================== FAILURES ===================================
[task 2020-01-07T21:06:58.384Z] 0:30.11 ________________ test_suites[desktop_unittest/mochitest-webgpu] ________________
[task 2020-01-07T21:06:58.385Z] 0:30.11
[task 2020-01-07T21:06:58.385Z] 0:30.11 item = ('desktop_unittest', ('mochitest', 'mochitest-webgpu'))
[task 2020-01-07T21:06:58.385Z] 0:30.11 patch_resolver = <function inner at 0x7f44ca2e7050>
[task 2020-01-07T21:06:58.385Z] 0:30.11 all_suites = [{'flavor': 'mochitest', 'srcdir_relpath': 'test'}, {'flavor': 'firefox-ui-functional', 'srcdir_relpath': 'test'}, {'f...'flavor': 'marionette', 'srcdir_relpath': 'test'}, {'flavor': 'telemetry-tests-client', 'srcdir_relpath': 'test'}, ...]
[task 2020-01-07T21:06:58.386Z] 0:30.11
[task 2020-01-07T21:06:58.386Z] 0:30.11 @pytest.mark.parametrize('item', generate_suites(), ids=idfn)
[task 2020-01-07T21:06:58.386Z] 0:30.11 def test_suites(item, patch_resolver, all_suites):
[task 2020-01-07T21:06:58.386Z] 0:30.11 """An integration test to make sure the suites returned by
[task 2020-01-07T21:06:58.387Z] 0:30.11 tasks.resolve_tests_by_suite match up with the names defined in
[task 2020-01-07T21:06:58.387Z] 0:30.11 mozharness.
[task 2020-01-07T21:06:58.387Z] 0:30.11 """
[task 2020-01-07T21:06:58.387Z] 0:30.11 patch_resolver([], all_suites)
[task 2020-01-07T21:06:58.387Z] 0:30.11 suites = resolve_tests_by_suite(['test'])
[task 2020-01-07T21:06:58.388Z] 0:30.11 os.environ['MOZHARNESS_TEST_PATHS'] = json.dumps(suites)
[task 2020-01-07T21:06:58.388Z] 0:30.11
[task 2020-01-07T21:06:58.388Z] 0:30.11 name, suite = item
[task 2020-01-07T21:06:58.388Z] 0:30.11 func = get_mozharness_test_paths(name)
[task 2020-01-07T21:06:58.388Z] 0:30.11 > assert func(suite)
[task 2020-01-07T21:06:58.388Z] 0:30.11 E AssertionError: assert None
[task 2020-01-07T21:06:58.389Z] 0:30.11 E + where None = <bound method DesktopUnittest._get_mozharness_test_paths of <scripts.desktop_unittest.DesktopUnittest object at 0x7f44ca4823d0>>(('mochitest', 'mochitest-webgpu'))
[task 2020-01-07T21:06:58.389Z] 0:30.11
[task 2020-01-07T21:06:58.389Z] 0:30.11 tools/tryselect/test/test_mozharness_integration.py:138: AssertionError
[task 2020-01-07T21:06:58.389Z] 0:30.11 ----------------------------- Captured stderr call -----------------------------
[task 2020-01-07T21:06:58.389Z] 0:30.11 21:06:57 INFO - ConsoleLogger online at 20200107 21:06:57Z in /builds/worker/checkouts/gecko
...

Flags: needinfo?(jgilbert)
Pushed by jgilbert@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/39313b112a04 Add mochitest-webgpu jobs, add subsuite = webgpu. r=jmaher,kvark

https://hg.mozilla.org/mozilla-central/rev/39313b112a04

Status: ASSIGNED → RESOLVED
Closed: 5 years ago
status-firefox74: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla74
Flags: needinfo?(jgilbert)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: