migrate green test suites over to macosx1014

RESOLVED FIXED

Status

task
RESOLVED FIXED
3 months ago
Yesterday

People

(Reporter: egao, Assigned: egao)

Tracking

(Blocks 1 bug, Regressed 6 bugs, {leave-open})

Details

Attachments

(23 attachments, 1 obsolete attachment)

47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review
47 bytes, text/x-phabricator-request
Details | Review

This is a tracker bug for migration of green test suites over to the macosx1014 machines.

Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/144de6677776
migrate marionette, wdspec, firefox UI, test-verify, mochitest-a11y suites to macosx1014 r=jmaher
Attachment #9069796 - Attachment description: Bug 1555454 - move cppunit, jittest to macosx1014 → Bug 1555454 - move cppunit, jittest, mochitest-devtools-webreplay to macosx1014
Attachment #9069796 - Attachment description: Bug 1555454 - move cppunit, jittest, mochitest-devtools-webreplay to macosx1014 → Bug 1555454 - move cppunit, jittest, mochitest-devtools-webreplay, mochiest-gpu to macosx1014
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/16b72409e491
move cppunit, jittest, mochitest-devtools-webreplay, mochiest-gpu to macosx1014 r=jmaher
Attachment #9070028 - Attachment description: Bug 1555454 - remove fail-if condition specific to mac for test_webgl_fingerprinting_resistance.html → Bug 1555454 - remove fail-if condition specific to mac for test_webgl_fingerprinting_resistance.html and migrate to running on macosx1014
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/1984b503b901
remove fail-if condition specific to mac for test_webgl_fingerprinting_resistance.html and migrate to running on macosx1014 r=jmaher

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&fromchange=1984b503b9016792ec7a5ea5283148debd1fdb38&tochange=ef0b98798dd6a3a36071ece35f6a2f86fc5ec170&searchStr=macosx1010-64%2Cdebug%2Cmochitests%2Ctest-macosx1010-64%2Fdebug-mochitest-webgl1-core-e10s%2Cm%28gl1c%29&selectedJob=250247780

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=250233317&repo=autoland&lineNumber=13147

Backout link: https://hg.mozilla.org/integration/autoland/rev/ef0b98798dd6a3a36071ece35f6a2f86fc5ec170

21:14:34 INFO - TEST-START | dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html
21:14:34 INFO - GECKO(896) | ++DOMWINDOW == 55 (0x127948400) [pid = 903] [serial = 130] [outer = 0x11ea46f20]
21:14:34 INFO - GECKO(896) | JavaScript warning: http://mochi.test:8888/tests/dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html, line 20: Error: WebGL warning: <SetDimensions>: Unable to restrict WebGL limits in order to resist fingerprinting
21:14:34 INFO - GECKO(896) | JavaScript warning: http://mochi.test:8888/tests/dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html, line 20: Error: WebGL warning: <SetDimensions>: Failed to create WebGL context: WebGL creation failed:
21:14:34 INFO - GECKO(896) | *
21:14:34 INFO - TEST-INFO | started process screencapture
21:14:34 INFO - TEST-INFO | screencapture: exit 0
21:14:34 INFO - TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html | Cannot get WebGL context
21:14:34 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
21:14:34 INFO - @dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html:22:16
21:14:34 INFO - async*@dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html:7:10
21:14:34 INFO - GECKO(896) | MEMORY STAT | vsize 5393MB | residentFast 202MB | heapAllocated 35MB
21:14:34 INFO - GECKO(896) | JavaScript error: http://mochi.test:8888/tests/dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html, line 26: TypeError: gl is null
21:14:34 INFO - TEST-OK | dom/canvas/test/webgl-mochitest/test_webgl_fingerprinting_resistance.html | took 174ms

Flags: needinfo?(egao)

The test test_webgl_fingerprinting_resistance.html seems to be intermittently passing on macosx1014. I have opened a bug (#1557166) to address this test. In the current form, I would need to disable the test prior to moving mochitest-webgl1-core to macosx1014.

Flags: needinfo?(egao)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/c02fd9857532
remove fail-if condition specific to mac for test_webgl_fingerprinting_resistance.html and migrate to running on macosx1014 r=jmaher
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/32d4c19550d8
move telemetry-tests-client to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/8e947c7dba45
migrate crashtests over to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/7130574015aa
migrate xpcshelltests to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d3d46e5ef066
migrate mochitest-webgl1-ext to macosx1014 r=gbrown

Backed out changeset d3d46e5ef066 (Bug 1555454) for test_2_conformance2__reading__format-r11f-g11f-b10f.html failures

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=macosx1010-64%2Cdebug%2Cmochitests%2Ctest-macosx1010-64%2Fdebug-mochitest-webgl2-core-e10s%2Cm%28gl2c%29&tochange=a8963ed279fd17a43ea5305b76a94d2d0b8d82cb&fromchange=b743690bf1a5d2f9d4906c75cd695c3dbe1198b0&selectedJob=251262579

Backout link: https://hg.mozilla.org/integration/autoland/rev/a8963ed279fd17a43ea5305b76a94d2d0b8d82cb

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=251262579&repo=autoland&lineNumber=2546

23:12:46 INFO - TEST-START | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 73 (0x125292000) [pid = 830] [serial = 374] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/offscreencanvas/offscreencanvas-transfer-image-bitmap.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 72 (0x126329800) [pid = 830] [serial = 390] [outer = 0x0] [url = about:blank]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 71 (0x115411000) [pid = 830] [serial = 386] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/generated/test_2_conformance2__programs__gl-get-frag-data-location.html]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 70 (0x12554b400) [pid = 830] [serial = 372] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/generated/test_2_conformance2__offscreencanvas__offscreencanvas-transfer-image-bitmap.html]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 69 (0x1252a4c00) [pid = 830] [serial = 384] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/checkout/conformance2/programs/active-built-in-attribs.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 68 (0x1251f6400) [pid = 830] [serial = 381] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/programs/active-built-in-attribs.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 67 (0x125298c00) [pid = 830] [serial = 383] [outer = 0x0] [url = about:blank]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 66 (0x125785400) [pid = 830] [serial = 385] [outer = 0x0] [url = http://mochi.test:8888/tests/SimpleTest/iframe-between-tests.html]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 65 (0x126328c00) [pid = 830] [serial = 391] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/checkout/conformance2/programs/gl-get-frag-data-location.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 64 (0x115409000) [pid = 830] [serial = 378] [outer = 0x0] [url = http://mochi.test:8888/tests/SimpleTest/iframe-between-tests.html]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 63 (0x12529a000) [pid = 830] [serial = 377] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/checkout/conformance2/offscreencanvas/offscreencanvas-transfer-image-bitmap.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | --DOMWINDOW == 62 (0x126324000) [pid = 830] [serial = 388] [outer = 0x0] [url = http://mochi.test:8888/tests/dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/programs/gl-get-frag-data-location.html?webglVersion=2]
23:12:46 INFO - GECKO(822) | ++DOMWINDOW == 63 (0x115409800) [pid = 830] [serial = 414] [outer = 0x122451f20]
23:12:46 INFO - GECKO(822) | ++DOCSHELL 0x124daf800 == 113 [pid = 830] [id = {35083eff-50f7-304f-8104-882377516d41}]
23:12:46 INFO - GECKO(822) | ++DOMWINDOW == 64 (0x10ee5e4c0) [pid = 830] [serial = 415] [outer = 0x0]
23:12:47 INFO - GECKO(822) | ++DOMWINDOW == 65 (0x11540ec00) [pid = 830] [serial = 416] [outer = 0x10ee5e4c0]
23:12:47 INFO - GECKO(822) | ++DOCSHELL 0x124db3000 == 114 [pid = 830] [id = {5991b173-2e97-de42-9cff-d494d97c3177}]
23:12:47 INFO - GECKO(822) | ++DOMWINDOW == 66 (0x1152c44c0) [pid = 830] [serial = 417] [outer = 0x0]
23:12:47 INFO - GECKO(822) | ++DOMWINDOW == 67 (0x124b29c00) [pid = 830] [serial = 418] [outer = 0x1152c44c0]
23:12:47 INFO - GECKO(822) | ++DOMWINDOW == 68 (0x115411000) [pid = 830] [serial = 419] [outer = 0x1152c44c0]
23:12:47 INFO - GECKO(822) | [Child 830, Main Thread] WARNING: NS_ENSURE_TRUE(nsContentUtils::IsJavascriptMIMEType(type)) failed: file /builds/worker/workspace/build/src/dom/script/ScriptLoader.cpp, line 1545
23:12:47 INFO - GECKO(822) | [Child 830, Main Thread] WARNING: NS_ENSURE_TRUE(nsContentUtils::IsJavascriptMIMEType(type)) failed: file /builds/worker/workspace/build/src/dom/script/ScriptLoader.cpp, line 1545
23:12:47 INFO - TEST-INFO | started process screencapture
23:12:47 INFO - TEST-INFO | screencapture: exit 0
23:12:47 INFO - Buffered messages logged at 23:12:47
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | A valid string reason is expected
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | Reason cannot be empty
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | context exists
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | Extension EXT_color_buffer_float is available
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | gl.FRAMEBUFFER_COMPLETE is gl.checkFramebufferStatus(gl.FRAMEBUFFER)
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | getError was expected value: NO_ERROR : Setup framebuffer with renderbuffer should succeed.
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [100,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [1000,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [2047,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [2500,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [4095,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [5000,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [8191,0,0,1]
23:12:47 INFO - Buffered messages finished
23:12:47 INFO - TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels 0 : got [Infinity,0,0,1], expected [8192,0,0,1], tol [128,0,0]
23:12:47 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
23:12:47 INFO - reportResults@dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:22:14
23:12:47 INFO - reportTestResultsToHarness@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:111:36
23:12:47 INFO - testFailed@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:241:5
23:12:47 INFO - clearAndVerifyColor@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:139:7
23:12:47 INFO - testReadPixelsFromColorChannelsWithVariousValues@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:169:5
23:12:47 INFO - testRenderbufferReadback@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:209:3
23:12:47 INFO - @dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:90:5
23:12:47 INFO - Not taking screenshot here: see the one that was previously logged
23:12:47 INFO - TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels 0 : got [NaN,0,0,1], expected [10000,0,0,1], tol [128,0,0]
23:12:47 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
23:12:47 INFO - reportResults@dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:22:14
23:12:47 INFO - reportTestResultsToHarness@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:111:36
23:12:47 INFO - testFailed@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:241:5
23:12:47 INFO - clearAndVerifyColor@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:139:7
23:12:47 INFO - testReadPixelsFromColorChannelsWithVariousValues@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:169:5
23:12:47 INFO - testRenderbufferReadback@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:209:3
23:12:47 INFO - @dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:90:5
23:12:47 INFO - Not taking screenshot here: see the one that was previously logged
23:12:47 INFO - TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels 0 : got [NaN,0,0,1], expected [16383,0,0,1], tol [128,0,0]
23:12:47 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
23:12:47 INFO - reportResults@dom/canvas/test/webgl-conf/mochi-single.html?checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:22:14
23:12:47 INFO - reportTestResultsToHarness@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:111:36
23:12:47 INFO - testFailed@dom/canvas/test/webgl-conf/checkout/js/js-test-pre.js:241:5
23:12:47 INFO - clearAndVerifyColor@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:139:7
23:12:47 INFO - testReadPixelsFromColorChannelsWithVariousValues@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:169:5
23:12:47 INFO - testRenderbufferReadback@dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:209:3
23:12:47 INFO - @dom/canvas/test/webgl-conf/checkout/conformance2/reading/format-r11f-g11f-b10f.html?webglVersion=2:90:5
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [16384,0,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,100,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,1000,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,2047,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,2500,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,4095,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,5000,0,1]
23:12:47 INFO - TEST-PASS | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels success : [0,8191,0,1]
23:12:47 INFO - Not taking screenshot here: see the one that was previously logged
23:12:47 INFO - TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-conf/generated/test_2_conformance2__reading__format-r11f-g11f-b10f.html | ReadPixels 0 : got [0,Infinity,0,1], expected [0,8192,0,1], tol [0,128,0]
23:12:47 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
...

Flags: needinfo?(egao)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/22f989cfc33f
migrate awsy over to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/1a1b1d4bfec6
migrate mochitest-webgl1-ext to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5460248e277e
migrate jsreftests to macosx1014 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/fbd9c64e4a31
migrate mochitest-devtools-chrome to macosx1014 r=gbrown

Fixed the issue with the webgl test that caused the backout, re-landing attempted.

Flags: needinfo?(egao)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/a1f01a303ff2
move mochitests-media to macosx1014 r=gbrown
Regressions: 1548439

Clearing ni as a new patch will be prepared that turns off the problematic tests (1487973, 1545737, 1544938)

Flags: needinfo?(egao)
Attachment #9072000 - Attachment description: Bug 1555454 - move mochitests-media to macosx1014 → Bug 1555454 - migrate mochitest-media to macosx1014 and turn off permafail tests
Attachment #9072887 - Attachment is obsolete: true
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/57a08ec35fae
migrate mochitest-media to macosx1014 and turn off permafail tests r=gbrown,jmaher

Changes:

  • migrate to macosx1014
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/18a887ffe30b
move mochitests-plain over to macosx1014 r=jmaher
Regressions: 1558593
Attachment #9076067 - Attachment description: Bug 1555454 - migrate mochitest-chrome to macosx1014 after disabling some tests → Bug 1555454 - migrate mochitest-chrome to macosx1014 and disable some tests in toolkit/content/tests/chrome/chrome.ini
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/01f56f8016d5
remove mochitest from running on macosx1010 r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/af08b89eaae1
migrate webgl2-core tests to macosx1014 by disabling test_2_conformance2__textures__misc__tex-base-level-bug.html r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/9b515d0fb83c
migrate mochitest-chrome to macosx1014 and disable some tests in toolkit/content/tests/chrome/chrome.ini r=gbrown
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/477989aa5e64
turn off mochitest-media for macosx1010 r=jmaher
Regressions: 1141245
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/eb4860f3fe47
migrate gtest to macosx1014 r=jmaher
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/f22974155fdc
migrate marionette-media to run on macosx1014-debug r=jmaher

== Change summary for alert #21750 (as of Fri, 05 Jul 2019 21:37:11 GMT) ==

Improvements:

8% raptor-tp6m-microsoft-support-geckoview-cold android-hw-g5-7-0-arm7-api-16 pgo 2,172.49 -> 1,996.66
5% raptor-tp6m-microsoft-support-geckoview-cold fcp android-hw-g5-7-0-arm7-api-16 pgo 2,816.38 -> 2,677.58

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=21750

(In reply to Florin Strugariu [:Bebe] (needinfo me) from comment #63)

== Change summary for alert #21750 (as of Fri, 05 Jul 2019 21:37:11 GMT) ==

Improvements:

8% raptor-tp6m-microsoft-support-geckoview-cold android-hw-g5-7-0-arm7-api-16 pgo 2,172.49 -> 1,996.66
5% raptor-tp6m-microsoft-support-geckoview-cold fcp android-hw-g5-7-0-arm7-api-16 pgo 2,816.38 -> 2,677.58

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=21750

Wrong tag sorry guys please ignore the previous comment

Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/ad5e0980c273
disable permafailing tests on macosx1014, migrate mochitest-browser-chrome to macosx1014 r=jmaher

Backed out changeset ad5e0980c273 (Bug 1555454) for central permafails on browser_devices_get_user_media.js a=backout
https://hg.mozilla.org/mozilla-central/rev/64fc6a9a9fb2

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&fromchange=5b21e285d546b38bbdae18c075c079f4b56350a7&tochange=c945c3197b71a92186ebc13f0cc4710b7ad1f8ba&selectedJob=257631337

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&fromchange=48797c5119a4d7fd1ff533501b6f80009cd3498c&tochange=64fc6a9a9fb2fbcb5483241e7cfde82e1dc5156f&selectedJob=257612123

Backout link: https://hg.mozilla.org/mozilla-central/rev/64fc6a9a9fb2fbcb5483241e7cfde82e1dc5156f

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=257612123&repo=mozilla-central&lineNumber=3009
00:16:08 INFO - TEST-START | browser/base/content/test/webrtc/browser_devices_get_user_media.js
00:16:08 INFO - GECKO(1813) | TEST DEVICES: No test devices found (in media.{audio,video}_loopback_dev, using fake streams.
00:16:09 INFO - GECKO(1813) | 2019-07-22 00:16:09.485 firefox[1813:13180] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)
00:17:38 INFO - TEST-INFO | started process screencapture
00:17:38 INFO - TEST-INFO | screencapture: exit 0
00:17:38 INFO - Buffered messages logged at 00:16:08
00:17:38 INFO - Entering test bound test
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | should start the test without any prior popup notification -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | should start the test with the control center hidden -
00:17:38 INFO - getUserMedia audio+video
00:17:38 INFO - requesting devices
00:17:38 INFO - Buffered messages logged at 00:16:09
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | webRTC-shareDevices notification shown -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | notification panel open -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | notification panel populated -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | expected notification getUserMedia:request -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | anchored to device icon -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | microphone selector visible -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | camera selector visible -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | screen selector hidden -
00:17:38 INFO - TEST-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | panel using devices icon -
00:17:38 INFO - Buffered messages logged at 00:16:53
00:17:38 INFO - Longer timeout required, waiting longer... Remaining timeouts: 1
00:17:38 INFO - Buffered messages finished
00:17:38 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/webrtc/browser_devices_get_user_media.js | Test timed out -
00:17:38 INFO - TEST-UNEXPECTED-PASS | browser/base/content/test/webrtc/browser_devices_get_user_media.js | We expect at least one assertion to fail because this test file is marked as fail-if in the manifest. -
00:17:38 INFO - TEST-INFO | expected FAIL
00:17:38 INFO - GECKO(1813) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
00:17:38 INFO - GECKO(1813) | MEMORY STAT | vsize 7590MB | residentFast 307MB | heapAllocated 76MB
00:17:38 INFO - TEST-OK | browser/base/content/test/webrtc/browser_devices_get_user_media.js | took 90084ms
00:17:38 INFO - TEST-FAIL | browser/base/content/test/webrtc/browser_devices_get_user_media.js | Found a tab after previous test timed out: https://example.com/browser/browser/base/content/test/webrtc/get_user_media.html -
00:17:38 INFO - checking window state
00:17:38 INFO - GECKO(1813) | must wait for focus
00:17:38 INFO - GECKO(1813) | JavaScript error: resource://testing-common/PromiseTestUtils.jsm, line 112: uncaught exception: Object
00:17:38 INFO - Console message: [JavaScript Error: "uncaught exception: Object" {file: "resource://testing-common/PromiseTestUtils.jsm" line: 112}]
00:23:48 INFO - Buffered messages finished
00:23:48 ERROR - TEST-UNEXPECTED-TIMEOUT | browser/base/content/test/webrtc/browser_devices_get_user_media.js (finished) | application timed out after 370 seconds with no output
00:23:48 ERROR - Force-terminating active process(es).
00:23:48 INFO - Determining child pids from psutil...
00:23:48 INFO - [1814, 1815, 1816, 1817, 1818, 1821, 1823]
00:23:48 INFO - ==> process 1813 launched child process 1814
00:23:48 INFO - ==> process 1813 launched child process 1815
00:23:48 INFO - ==> process 1813 launched child process 1816
00:23:48 INFO - ==> process 1813 launched child process 1817
00:23:48 INFO - ==> process 1813 launched child process 1818
00:23:48 INFO - ==> process 1813 launched child process 1821
00:23:48 INFO - ==> process 1813 launched child process 1823
00:23:48 INFO - Found child pids: set([1814, 1815, 1816, 1817, 1818, 1821, 1823])

Flags: needinfo?(egao)

Re-pushing a fixed patch for macosx1014 mochitest browser chrome.

Flags: needinfo?(egao)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/68e79f66bb58
disable permafailing tests on macosx1014, migrate mochitest-browser-chrome to macosx1014 r=jmaher
Whiteboard: checkin-needed-beta

ESR Uplift Approval Request

  • If this is not a sec:{high,crit} bug, please state case for ESR consideration: this allows us to run tests on osx 10.14 on ESR so we can deprecate the 10.10 machines.
  • User impact if declined:
  • Fix Landed on Version: 70
  • Risk to taking this patch: Low
  • Why is the change risky/not risky? (and alternatives if risky): Simple migration from one platform to another, with some tests being turned off to facilitate move
  • String or UUID changes made by this patch:

Patch requested to be uplifted is D38783.

Does anything else need uplift here at the moment?

Flags: needinfo?(egao)

:aryx - D39399 re-enables 4 tests for macosx1014, so while it won't be noticeable from a user perspective, once it lands to mozilla-central it could be worth uplifting to Beta and/or ESR.

Flags: needinfo?(egao) → needinfo?(aryx.bugmail)

is gtest, MhM, and BC* ported over?

:jmaher - the mozilla-beta uplift that Aryx did ports over gtest, browser-chrome. Not sure about marionette, but I thought that was migrated over already.

Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/6385ede0bcca
re-enable certain mochitest-browser-chrome tests on macosx1014 that are not permafails r=jmaher
Regressions: 1569359
Regressions: 1569368
Regressions: 1533895
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/8d423bbe5469
disable browser-screenshot test cases that time out on macosx1014 r=jmaher
Flags: needinfo?(aryx.bugmail)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/b9d11179074b
disable browser_preferences.js test on macosx1014 due to intermittent timeout and crash r=jmaher

Given that all suites are now migrated over to macosx1014, this bug can now be closed.

Status: NEW → RESOLVED
Closed: Yesterday
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.