Closed Bug 1423888 Opened 7 years ago Closed 7 years ago

Intermittent autophone-mochitest-dom-media-tests | Test exited with return code 1

Categories

(Core :: Graphics: CanvasWebGL, defect)

Product:
Core
Component:
Graphics: CanvasWebGL
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Depends on 1 open bug)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell disabled])

In the last 7 days there are 33 failures. They occur mostly on android-6-0-armv8-api16 debug and the rest of them on android-5-0-armv8-api16 debug, android-4-4-armv7-api16 opt. A recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=154858080&lineNumber=43 and a relevant part of the log: 2018-01-08 16:04:41,527 nexus-6p-04 INFO <2018-01-09T00:04:41+00:00> nexus-6p-04 (WORKING): Starting test mochitest-dom-media-tests 40 2018-01-08 16:04:41,528 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests logging to /mozilla/autophone/autophone/builds/aHR0cHM6Ly9xdWV1ZS50YXNrY2x1c3Rlci5uZXQvdjEvdGFzay9EOVIzT1NlTFFUaW9hWDZrd3dWcWh3L3J1bnMvMC9hcnRpZmFjdHMvcHVibGljL2J1aWxk/tests/mochitest-dom-media-tests-mochitests-dom-media-tests-settings-debug.ini-1-nexus-6p-04.log 41 2018-01-08 16:04:41,539 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests cmdline = python -u mochitest/runtestsremote.py --manifest=mochitest/tests/dom/media/tests/mochitest/mochitest.ini --testrun-manifest-file=tmpICN0uk.json --certificate-path=certs --console-level=DEBUG --websocket-process-bridge-port=43713 --subsuite=media --deviceSerial=84B7N15A28009658 --remoteTestRoot=/sdcard/tests/autophone --app=org.mozilla.fennec_aurora --xre-path=/mozilla/autophone/downloads/firefox --utility-path=/mozilla/autophone/downloads/tests/bin --timeout=300 --remote-webserver=10.252.73.233 --http-port=53445 --ssl-port=47171 --total-chunks=1 --this-chunk=1 --pidfile=tmpRIzgb4.pid --remote-logfile=tmp1HSK_c.log --symbols-path=/mozilla/autophone/autophone/builds/aHR0cHM6Ly9xdWV1ZS50YXNrY2x1c3Rlci5uZXQvdjEvdGFzay9EOVIzT1NlTFFUaW9hWDZrd3dWcWh3L3J1bnMvMC9hcnRpZmFjdHMvcHVibGljL2J1aWxk/symbols 42 2018-01-08 16:04:41,539 nexus-6p-04 INFO <2018-01-09T00:04:41+00:00> nexus-6p-04 (WORKING): Running test mochitest-dom-media-tests chunk 1 of 1 43 2018-01-08 16:12:05,688 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests TEST-UNEXPECTED-FAIL | autophone-mochitest-dom-media-tests | Test exited with return code 1 44 2018-01-08 16:12:05,688 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests runtestsremote.py return code 1 45 2018-01-08 16:12:05,689 nexus-6p-04 INFO <2018-01-09T00:12:05+00:00> nexus-6p-04 (WORKING): Completed test mochitest-dom-media-tests chunk 1 of 1 46 2018-01-08 16:12:05,689 nexus-6p-04 INFO <2018-01-09T00:12:05+00:00> nexus-6p-04 (WORKING): runtestsremote.py run_job exit 47 2018-01-08 16:12:05,690 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests Test autophone-mochitest-dom-media-tests elapsed time: 0:07:28.235406 48 ========= Finished Run Test (results: 0, elapsed: 444 secs) (at 2018-01-08 16:12:05.690650) ========= 49 ========= Started Unittest Log (results: 0, elapsed: 0 secs) (at 2018-01-08 16:12:05.690650) ========= :jolin, can you please have a look?
Flags: needinfo?(jolin)
Whiteboard: [stockwell needswork]
The log shows the test crashed by MOZ_Assert in canvas code. Change component to Canvas:WebGL. 2018-01-08 16:12:05,822 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests PROCESS-CRASH | dom/media/tests/mochitest/test_peerConnection_captureStream_canvas_webgl.html | application crashed [@ mozilla::AssertMaskedUintParamCorrect] 2018-01-08 16:12:07,281 nexus-6p-04 INFO UnitTestJob mozilla-central 20180108220617 debug api-23 android-api-16 mochitest-dom-media-tests 01-08 19:10:23.149 F/MOZ_Assert( 9405): Assertion failure: false (Bad cached value.), at /builds/worker/workspace/build/src/dom/canvas/WebGLContextUtils.cpp:733
Component: Audio/Video → Canvas: WebGL
Flags: needinfo?(jolin)
Product: Firefox for Android → Core
FYI, This is a generic error message which could be caused by any number of failures. There could conceivably be 31 different bugs lumped together hiding under this error message.
:snorp can you help out here? is there work we can do to make this error more actionable?
Flags: needinfo?(snorp)
This failure is too generic since any crash will result in a return code of 1. The particular perm failure you are seeing is Android 6.0 debug assertion: F/MOZ_Assert( 7202): Assertion failure: false (Bad cached value.), at /builds/worker/workspace/build/src/dom/canvas/WebGLContextUtils.cpp:733 PROCESS-CRASH | dom/media/tests/mochitest/test_peerConnection_captureStream_canvas_webgl.html | application crashed [@ mozilla::AssertMaskedUintParamCorrect] mochitest-dom-media-tests Thread 10 (crashed) 0 libxul.so!mozilla::AssertMaskedUintParamCorrect [WebGLContextUtils.cpp:4d4c68ba3b03 : 733 + 0x0] r0 = 0x00000086 r1 = 0xef45d150 r2 = 0xde79fc03 r3 = 0x000002dd r4 = 0x000002dd r5 = 0x00000000 r6 = 0x000000ff r7 = 0xef45d680 r8 = 0x00000000 r9 = 0xef45d783 r10 = 0x00000004 r12 = 0xef45d178 fp = 0xde77c3cc sp = 0xef45d660 lr = 0xdad05309 pc = 0xdbde3c64 Found by: given as instruction pointer in context 1 libxul.so!mozilla::WebGLContext::AssertCachedGlobalState [WebGLContextUtils.cpp:4d4c68ba3b03 : 827 + 0x1] r4 = 0xc6108000 r5 = 0xdbde3c0d r6 = 0x00000000 r7 = 0xef45d6a8 r8 = 0x00000001 r9 = 0xef45d783 r10 = 0x00000004 fp = 0xde77c3cc sp = 0xef45d688 lr = 0xdbde3eff pc = 0xdbde3eff Found by: call frame info 2 libxul.so!mozilla::WebGLContext::ForceClearFramebufferWithDefaultValues [WebGLContext.cpp:4d4c68ba3b03 : 1449 + 0x3] r4 = 0xc6108000 r5 = 0x00004500 r6 = 0x00000000 r7 = 0xef45d6d0 r8 = 0x00000001 r9 = 0xef45d783 r10 = 0x00000004 fp = 0xde77c3cc sp = 0xef45d6b0 lr = 0xdbdd4c63 pc = 0xdbdd4c63 Found by: call frame info 3 libxul.so!mozilla::WebGLContext::ValidateAndInitFB [WebGLContext.cpp:4d4c68ba3b03 : 2015 + 0x5] r4 = 0xc6108000 r5 = 0x00000000 r6 = 0x00000005 r7 = 0xef45d6e0 r8 = 0x00000001 r9 = 0xef45d783 r10 = 0x00000004 fp = 0xde77c3cc sp = 0xef45d6d8 lr = 0xdbdcd237 pc = 0xdbdcd237 Found by: call frame info 4 libxul.so!mozilla::WebGLContext::BindCurFBForDraw [WebGLContext.cpp:4d4c68ba3b03 : 2032 + 0x3] r4 = 0xc6108000 r5 = 0x00000000 r6 = 0x00000005 r7 = 0xef45d6f0 r8 = 0x00000001 r9 = 0xef45d783 r10 = 0x00000004 fp = 0xde77c3cc sp = 0xef45d6e8 lr = 0xdbdcdcb7 pc = 0xdbdcdcb7 Found by: call frame info 5 libxul.so!mozilla::ScopedDrawHelper::ScopedDrawHelper [WebGLContextDraw.cpp:4d4c68ba3b03 : 246 + 0x9] r4 = 0xef45d778 r5 = 0x00000000 r6 = 0x00000005 r7 = 0xef45d728 r8 = 0x00000001 r9 = 0xef45d783 r10 = 0x00000004 fp = 0xde77c3cc sp = 0xef45d6f8 lr = 0xdbdd9f41 pc = 0xdbdd9f41 Found by: call frame info 6 libxul.so!mozilla::WebGLContext::DrawArraysInstanced [WebGLContextDraw.cpp:4d4c68ba3b03 : 522 + 0xf] r3 = 0x00000005 r4 = 0xc6108000 r5 = 0xc6806800 r6 = 0xef45d784 r7 = 0xef45d7b0 r8 = 0x00000001 r9 = 0xde77c3cc r10 = 0x00000004 fp = 0x00000000 sp = 0xef45d730 lr = 0xdbdd9dbd pc = 0xdbdd9dbd Found by: call frame info 7 libxul.so!mozilla::WebGLContext::DrawArrays [WebGLContext.h:4d4c68ba3b03 : 1308 + 0x11] r4 = 0xef45d7f0 r5 = 0xd7e13800 r6 = 0x00000000 r7 = 0xef45d7c0 r8 = 0xc6108000 r9 = 0xef45d80c r10 = 0xdbd775ed fp = 0xffffff82 sp = 0xef45d7b8 lr = 0xdbbdb937 pc = 0xdbbdb937 Found by: call frame info 8 libxul.so!mozilla::dom::WebGLRenderingContextBinding::drawArrays [WebGLRenderingContextBinding.cpp: : 16581 + 0x3]
Filed bug 1431418 for the WebGL assertion.
Flags: needinfo?(snorp)
Depends on: 1431418
In the last 7 days it has failed 113 times, on Android platform, affecting mainly debug build type but there are a few occurrences on opt build types. Failing test: Autophone Mochitest DOM Media 2 tests Link to a recent log: https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=158589062&lineNumber=43 Part of that log: 2018-01-25 18:40:46,833 nexus-6p-04 INFO <2018-01-26T02:40:46+00:00> nexus-6p-04 (WORKING): Starting test mochitest-dom-media-tests 40 2018-01-25 18:40:46,834 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests logging to /mozilla/autophone/autophone/builds/aHR0cHM6Ly9xdWV1ZS50YXNrY2x1c3Rlci5uZXQvdjEvdGFzay9Cb0ZaMW5DOFJTLVg2VmRmbUdxU1lnL3J1bnMvMC9hcnRpZmFjdHMvcHVibGljL2J1aWxk/tests/mochitest-dom-media-tests-mochitests-dom-media-tests-settings-debug.ini-1-nexus-6p-04.log 41 2018-01-25 18:40:46,841 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests cmdline = python -u mochitest/runtestsremote.py --manifest=mochitest/tests/dom/media/tests/mochitest/mochitest.ini --testrun-manifest-file=tmpDu22QZ.json --certificate-path=certs --console-level=DEBUG --websocket-process-bridge-port=41543 --subsuite=media --deviceSerial=84B7N15A28009658 --remoteTestRoot=/sdcard/tests/autophone --app=org.mozilla.fennec_aurora --xre-path=/mozilla/autophone/downloads/firefox --utility-path=/mozilla/autophone/downloads/tests/bin --timeout=300 --remote-webserver=10.252.73.233 --http-port=59675 --ssl-port=59343 --total-chunks=1 --this-chunk=1 --pidfile=tmpuP4EU1.pid --remote-logfile=tmpNDhi_W.log --symbols-path=/mozilla/autophone/autophone/builds/aHR0cHM6Ly9xdWV1ZS50YXNrY2x1c3Rlci5uZXQvdjEvdGFzay9Cb0ZaMW5DOFJTLVg2VmRmbUdxU1lnL3J1bnMvMC9hcnRpZmFjdHMvcHVibGljL2J1aWxk/symbols 42 2018-01-25 18:40:46,841 nexus-6p-04 INFO <2018-01-26T02:40:46+00:00> nexus-6p-04 (WORKING): Running test mochitest-dom-media-tests chunk 1 of 1 43 2018-01-25 18:48:11,801 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests TEST-UNEXPECTED-FAIL | autophone-mochitest-dom-media-tests | Test exited with return code 1 44 2018-01-25 18:48:11,802 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests runtestsremote.py return code 1 45 2018-01-25 18:48:11,802 nexus-6p-04 INFO <2018-01-26T02:48:11+00:00> nexus-6p-04 (WORKING): Completed test mochitest-dom-media-tests chunk 1 of 1 46 2018-01-25 18:48:11,803 nexus-6p-04 INFO <2018-01-26T02:48:11+00:00> nexus-6p-04 (WORKING): runtestsremote.py run_job exit 47 2018-01-25 18:48:11,803 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests Test autophone-mochitest-dom-media-tests elapsed time: 0:07:29.166763 48 ========= Finished Run Test (results: 0, elapsed: 444 secs) (at 2018-01-25 18:48:11.804241) ========= 49 ========= Started Unittest Log (results: 0, elapsed: 0 secs) (at 2018-01-25 18:48:11.804241) ========= 50 2018-01-25 18:48:11,806 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests Device info: 51 2018-01-25 18:48:11,806 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests uptime: 0 days 0 hours 7 minutes 8 seconds 52 2018-01-25 18:48:11,807 nexus-6p-04 INFO UnitTestJob autoland 20180126003321 debug api-23 android-api-16 mochitest-dom-media-tests memtotal: 2767480 kB This bug is blocked by https://bugzilla.mozilla.org/show_bug.cgi?id=1431418 ni :snorp, :milan.
Please note that unit testing on Autophone has been disabled everywhere but on try. You can select these tests via autophone-mochitest-dom-media-tests
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.