Open Bug 1464541 Opened 6 years ago Updated 16 days ago

Categories

(Core :: DOM: Service Workers, defect, P3)

defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Blocks 1 open bug)

Details

(Keywords: intermittent-failure, leave-open, Whiteboard: [stockwell disabled])

Attachments

(1 file, 6 obsolete files)

Filed by: aiakab [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=180266000&repo=autoland

https://queue.taskcluster.net/v1/task/BWkRva7ZRsuC5ysOgNiatg/runs/0/artifacts/public/logs/live_backing.log

[task 2018-05-25T16:04:39.753Z] 16:04:39     INFO - TEST-START | /service-workers/service-worker/fetch-canvas-tainting-video.https.html
[task 2018-05-25T16:04:41.901Z] 16:04:41     INFO - 
[task 2018-05-25T16:04:41.901Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "" should be TAINTED 
[task 2018-05-25T16:04:41.901Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "anonymous" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.902Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "use-credentials" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.902Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "" should be TAINTED 
[task 2018-05-25T16:04:41.903Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "anonymous" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.904Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "use-credentials" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.904Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.904Z] 16:04:41     INFO - TEST-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&credentials=same-origin&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "TAINTED"
[task 2018-05-25T16:04:41.905Z] 16:04:41     INFO - canvas_taint_test/</<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:13:11
[task 2018-05-25T16:04:41.905Z] 16:04:41     INFO - promise callback*canvas_taint_test/<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:11:14
[task 2018-05-25T16:04:41.906Z] 16:04:41     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:1538:20
[task 2018-05-25T16:04:41.907Z] 16:04:41     INFO - promise_test/tests.promise_tests<@https://web-platform.test:8443/resources/testharness.js:580:27
[task 2018-05-25T16:04:41.907Z] 16:04:41     INFO - promise callback*promise_test@https://web-platform.test:8443/resources/testharness.js:576:31
[task 2018-05-25T16:04:41.907Z] 16:04:41     INFO - canvas_taint_test@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:10:3
[task 2018-05-25T16:04:41.908Z] 16:04:41     INFO - do_canvas_tainting_tests@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:182:3
[task 2018-05-25T16:04:41.908Z] 16:04:41     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
[task 2018-05-25T16:04:41.908Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "anonymous" should be NOT_TAINTED 
[task 2018-05-25T16:04:41.908Z] 16:04:41     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be LOAD_ERROR 
[task 2018-05-25T16:04:41.909Z] 16:04:41     INFO - TEST-UNEXPECTED-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACACredentials%3Dtrue%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "LOAD_ERROR"
[task 2018-05-25T16:04:41.910Z] 16:04:41     INFO - canvas_taint_test/</<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:13:11
[task 2018-05-25T16:04:41.910Z] 16:04:41     INFO - promise callback*canvas_taint_test/<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:11:14
[task 2018-05-25T16:04:41.910Z] 16:04:41     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:1538:20
[task 2018-05-25T16:04:41.910Z] 16:04:41     INFO - promise_test/tests.promise_tests<@https://web-platform.test:8443/resources/testharness.js:580:27
[task 2018-05-25T16:04:41.911Z] 16:04:41     INFO - promise callback*promise_test@https://web-platform.test:8443/resources/testharness.js:576:31
[task 2018-05-25T16:04:41.911Z] 16:04:41     INFO - canvas_taint_test@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:10:3
[task 2018-05-25T16:04:41.911Z] 16:04:41     INFO - do_canvas_tainting_tests@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:201:3
[task 2018-05-25T16:04:41.911Z] 16:04:41     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
[task 2018-05-25T16:04:41.914Z] 16:04:41     INFO - ......
[task 2018-05-25T16:04:41.914Z] 16:04:41     INFO - TEST-OK | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | took 2137ms
Component: web-platform-tests → DOM: Service Workers
Product: Testing → Core
Version: Version 3 → unspecified
Priority: -- → P3
Over the last 7 days there are 51 failures on this bug. These happen on windows7-32, linux64-qr, linux64-nightly, linux64, linux32.

Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?job_id=182021912&repo=mozilla-inbound&lineNumber=31576

[task 2018-06-06T05:00:42.810Z] 05:00:42     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
[task 2018-06-06T05:00:42.810Z] 05:00:42     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "anonymous" should be NOT_TAINTED 
[task 2018-06-06T05:00:42.810Z] 05:00:42     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be LOAD_ERROR 
[task 2018-06-06T05:00:42.811Z] 05:00:42     INFO - TEST-UNEXPECTED-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACACredentials%3Dtrue%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "LOAD_ERROR"
Flags: needinfo?(mdaly)
Comment on attachment 8984773 [details] [diff] [review]
Bug1464541.patch- Disable /fetch-canvas-tainting-video.https.html  for Linux failures

Review of attachment 8984773 [details] [diff] [review]:
-----------------------------------------------------------------

::: testing/web-platform/meta/service-workers/service-worker/fetch-canvas-tainting-video.https.html.ini
@@ +4,4 @@
>  
>    [url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&credentials=same-origin&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be NOT_TAINTED]
>      expected: FAIL
> +  disable:

this needs to be "disabled"
Attachment #8984773 - Flags: review?(jmaher) → review-
:henrietta, I am not sure who is on shift, can you assign this to someone on shift?
Flags: needinfo?(jmaher) → needinfo?(hmaior)
Attached patch bug_1464541.patch (obsolete) — Splinter Review
Attachment #8984773 - Attachment is obsolete: true
Flags: needinfo?(hmaior)
Attachment #8984925 - Flags: review?(jmaher)
Comment on attachment 8984925 [details] [diff] [review]
bug_1464541.patch

Review of attachment 8984925 [details] [diff] [review]:
-----------------------------------------------------------------

this disabled clause needs to be right under the top condition [fetch-canvas-tainting-video.https.html], not at the bottom of the file.
Attachment #8984925 - Flags: review?(jmaher) → review-
Henrietta, can you help pass this along to the next shift?
Flags: needinfo?(hmaior)
Made the requested changes.
Attachment #8984925 - Attachment is obsolete: true
Flags: needinfo?(hmaior)
Attachment #8984958 - Flags: review?(jmaher)
Comment on attachment 8984958 [details] [diff] [review]
Disable fetch-canvas-tainting-video.https.html for Linux failures.

Review of attachment 8984958 [details] [diff] [review]:
-----------------------------------------------------------------

::: testing/web-platform/meta/2dcontext/fill-and-stroke-styles/2d.pattern.image.broken.html.ini
@@ -7,2 @@
>        if not debug and (os == "win") and (version == "6.2.9200") and (processor == "x86_64") and (bits == 64): FAIL
> -

these changes are not part of this bug; please keep this bug to the single file.  In addition, the 6.2.9200 clause can be removed since that is windows 8 :)
Attachment #8984958 - Flags: review?(jmaher) → review-
Comment on attachment 8985011 [details] [diff] [review]
Disable /service-workers/service-worker/fetch-canvas-tainting-video.https.html for frequent failures on Linux r=jmaher

Review of attachment 8985011 [details] [diff] [review]:
-----------------------------------------------------------------

sorry for the additional r-

::: testing/web-platform/meta/service-workers/service-worker/fetch-canvas-tainting-video.https.html.ini
@@ +1,3 @@
>  [fetch-canvas-tainting-video.https.html]
> +  disabled:
> +	if (os == "linux"): https://bugzilla.mozilla.org/show_bug.cgi?id=1464541

please make this 2 space indentation on the if line.
Attachment #8985011 - Flags: review?(jmaher) → review-
Comment on attachment 8985014 [details] [diff] [review]
Disable fetch-canvas-tainting-video.https.html for frequent failures on Linux r=jmaher

Review of attachment 8985014 [details] [diff] [review]:
-----------------------------------------------------------------

looks great!
Attachment #8985014 - Flags: review?(jmaher) → review+
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Pushed by dluca@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/201ad11695e3
Disable /service-workers/service-worker/fetch-canvas-tainting-video.https.html for frequent failures on Linux r=jmaher
Keywords: checkin-needed
Looks like we're on target here.
Flags: needinfo?(mdaly)
https://hg.mozilla.org/releases/mozilla-esr60/rev/746e926644b9

IMO this should be disabled on all platforms, FWIW. The test is pretty clearly flaky across the board.
We are trying to build a tool to automatically classify intermittent failures, which would provide a starting point for fixing the bug, reducing the manual work for the developers.
We are collecting some feedback on the results, to see if they’re good enough and where we need to improve.
    
For this bug, the tool says that the intermittent failure is most likely a:
Concurrency Issue: This includes tests in which failures occur due to thread management issues (different threads or their outcomes depending on an implicit ordering), race conditions and/or deadlocks, and issues related to an asynchronous waits (e.g. a process trying to access an external resource or continuing before the external resource is available).


Once you’re done investigating and/or fixing the bug, could you tell me:
- Did the tool correctly recognize the type of intermittent failure?
- Did the information from the tool help your analysis, the bug fixing process, or anything in the process? (please also let us know how the tool was useful and/or what would improve the tool's usefulness for you)
There are 29 total failures in the last 7 days, majority on Windows. 
Failure log:
https://treeherder.mozilla.org/logviewer.html#?job_id=200924359&repo=autoland&lineNumber=5541

03:46:17     INFO - TEST-START | /service-workers/service-worker/fetch-canvas-tainting-video.https.html
03:46:17     INFO - 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "" should be TAINTED 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "anonymous" should be LOAD_ERROR 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=no-cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO" with crossOrigin "use-credentials" should be LOAD_ERROR 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be LOAD_ERROR 
03:46:17     INFO - TEST-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&credentials=same-origin&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "TAINTED"
03:46:17     INFO - canvas_taint_test/</<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:13:11
03:46:17     INFO - promise callback*canvas_taint_test/<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:12:10
03:46:17     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:1573:20
03:46:17     INFO - promise_test/tests.promise_tests</<@https://web-platform.test:8443/resources/testharness.js:591:31
03:46:17     INFO - promise_test/tests.promise_tests<@https://web-platform.test:8443/resources/testharness.js:590:20
03:46:17     INFO - promise callback*promise_test@https://web-platform.test:8443/resources/testharness.js:589:31
03:46:17     INFO - canvas_taint_test@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:10:3
03:46:17     INFO - do_canvas_tainting_tests@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:182:3
03:46:17     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "anonymous" should be NOT_TAINTED 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be LOAD_ERROR 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACACredentials%3Dtrue%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "use-credentials" should be NOT_TAINTED 
03:46:17     INFO - TEST-PASS | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be LOAD_ERROR 
03:46:17     INFO - TEST-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&credentials=same-origin&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "TAINTED"
03:46:17     INFO - canvas_taint_test/</<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:13:11
03:46:17     INFO - promise callback*canvas_taint_test/<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:12:10
03:46:17     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:1573:20
03:46:17     INFO - promise_test/tests.promise_tests</<@https://web-platform.test:8443/resources/testharness.js:591:31
03:46:17     INFO - promise_test/tests.promise_tests<@https://web-platform.test:8443/resources/testharness.js:590:20
03:46:17     INFO - promise callback*promise_test@https://web-platform.test:8443/resources/testharness.js:589:31
03:46:17     INFO - canvas_taint_test@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:10:3
03:46:17     INFO - do_canvas_tainting_tests@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:215:3
03:46:17     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
03:46:17     INFO - TEST-UNEXPECTED-FAIL | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | url "https://www1.web-platform.test:8443/service-workers/service-worker/resources/fetch-access-control.py?VIDEO&mode=cors&url=https%3A%2F%2Fwww1.web-platform.test%3A8443%2Fservice-workers%2Fservice-worker%2Fresources%2Ffetch-access-control.py%3FVIDEO%26ACAOrigin%3Dhttps%3A%2F%2Fweb-platform.test%3A8443" with crossOrigin "anonymous" should be NOT_TAINTED - assert_equals: expected "NOT_TAINTED" but got "LOAD_ERROR"
03:46:17     INFO - canvas_taint_test/</<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:13:11
03:46:17     INFO - promise callback*canvas_taint_test/<@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:12:10
03:46:17     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:1573:20
03:46:17     INFO - promise_test/tests.promise_tests</<@https://web-platform.test:8443/resources/testharness.js:591:31
03:46:17     INFO - promise_test/tests.promise_tests<@https://web-platform.test:8443/resources/testharness.js:590:20
03:46:17     INFO - promise callback*promise_test@https://web-platform.test:8443/resources/testharness.js:589:31
03:46:17     INFO - canvas_taint_test@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:10:3
03:46:17     INFO - do_canvas_tainting_tests@https://web-platform.test:8443/service-workers/service-worker/resources/fetch-canvas-tainting-tests.js:221:3
03:46:17     INFO - @https://web-platform.test:8443/service-workers/service-worker/fetch-canvas-tainting-video.https.html:11:1
03:46:17     INFO - ...
03:46:17     INFO - TEST-OK | /service-workers/service-worker/fetch-canvas-tainting-video.https.html | took 659ms
03:46:17     INFO - PID 4028 | 1537587977899	Marionette	INFO	Stopped listening on port 2828
03:46:17     INFO - PID 4028 | [Parent 4028, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Child 5828, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Parent 4028, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Child 5788, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Child 5788, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Parent 4028, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Child 4548, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:17     INFO - PID 4028 | [Child 4548, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
03:46:18     INFO - PID 4028 | [Parent 4028, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188
03:46:18     INFO - Browser exited with return code 0
03:46:18  WARNING - u'runner_teardown': ()
03:46:18     INFO - Setting up ssl
03:46:18     INFO - certutil | 
03:46:18     INFO - certutil | 
03:46:18     INFO - certutil | 
03:46:18     INFO - Certificate Nickname                                         Trust Attributes
03:46:18     INFO -                                                              SSL,S/MIME,JAR/XPI
03:46:18     INFO - 
03:46:18     INFO - web-platform-tests                                           CT,, 
03:46:18     INFO - 
03:46:18     INFO - Application command: Z:\task_1537583931\build\application\firefox\firefox.exe -marionette about:blank -profile c:\users\task_1537583931\appdata\local\temp\tmpd1lfwy.mozrunner
03:46:18     INFO - Starting runner
03:46:20     INFO - PID 5676 | 1537587980071	Marionette	INFO	Listening on port 2828



Joel, Ryan mentioned in Comment 27 that this should be disabled on all platforms, can you please weigh in here?
Flags: needinfo?(jmaher)
as this is disabled in linux already, lets disable for all cases.
Flags: needinfo?(jmaher) → needinfo?(ebalazs)
Attached patch Disable test on all platforms (obsolete) — Splinter Review
Flags: needinfo?(ebalazs)
Attachment #9012488 - Flags: review?(jmaher)
Comment on attachment 9012488 [details] [diff] [review]
Disable test on all platforms

Review of attachment 9012488 [details] [diff] [review]:
-----------------------------------------------------------------

thanks!
Attachment #9012488 - Flags: review?(jmaher) → review+
Pushed by ebalazs@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/03240d33ff44
Disable Disable fetch-canvas-tainting-video.https.html for frequent failures on all platform. r=jmaher
Keywords: checkin-needed
Backed out changeset 03240d33ff44 (bug 1464541) for failing at /workspace/build/tests/web-platform/runtests.py on a CLOSED TREE

Backout link: https://hg.mozilla.org/integration/mozilla-inbound/rev/b4e578f7ebe615c04972af475e73c89e6f2297ea

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&resultStatus=testfailed,busted,exception&revision=03240d33ff44c263e257b53f14aa45f57cc70e6d

Log link: https://treeherder.mozilla.org/logviewer.html#?job_id=201880878&repo=mozilla-inbound&lineNumber=935

Log snippet: 

[task 2018-09-27T08:03:14.438Z] 08:03:14     INFO - Calling ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/web-platform/runtests.py', '--log-raw=-', '--log-raw=/builds/worker/workspace/build/blobber_upload_dir/wpt_raw.log', '--log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt_errorsummary.log', '--binary=/builds/worker/workspace/build/application/firefox/firefox', '--symbols-path=https://queue.taskcluster.net/v1/task/S250lZrwRuWnZTY1p66k8g/artifacts/public/build/target.crashreporter-symbols.zip', '--stackwalk-binary=/usr/local/bin/linux64-minidump_stackwalk', '--stackfix-dir=/builds/worker/workspace/build/tests/bin', '--run-by-dir=3', '--no-pause-after-test', '--test-type=testharness', '--stylo-threads=4', '--total-chunks=12', '--this-chunk=8', '--prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs', '--processes=1', '--config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini', '--ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem', '--host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=/builds/worker/workspace/build/tests/bin/certutil'] with output_timeout 1000
[task 2018-09-27T08:03:14.884Z] 08:03:14     INFO - Updating test manifest /builds/worker/workspace/build/tests/web-platform/meta/MANIFEST.json
[task 2018-09-27T08:03:18.923Z] 08:03:18     INFO - STDOUT: INFO:manifest:Updating manifest
[task 2018-09-27T08:03:29.659Z] 08:03:29     INFO - STDOUT: DEBUG:manifest:Opening manifest at /builds/worker/workspace/build/tests/web-platform/meta/MANIFEST.json
[task 2018-09-27T08:03:34.071Z] 08:03:34     INFO - Updating test manifest /builds/worker/workspace/build/tests/web-platform/mozilla/meta/MANIFEST.json
[task 2018-09-27T08:03:34.087Z] 08:03:34     INFO - STDOUT: INFO:manifest:Updating manifest
[task 2018-09-27T08:03:34.087Z] 08:03:34     INFO - STDOUT: INFO:manifest:Updating manifest
[task 2018-09-27T08:03:34.128Z] 08:03:34     INFO - STDOUT: DEBUG:manifest:Opening manifest at /builds/worker/workspace/build/tests/web-platform/mozilla/meta/MANIFEST.json
[task 2018-09-27T08:03:34.129Z] 08:03:34     INFO - STDOUT: DEBUG:manifest:Opening manifest at /builds/worker/workspace/build/tests/web-platform/mozilla/meta/MANIFEST.json
[task 2018-09-27T08:03:37.064Z] 08:03:37     INFO - Closing logging queue
[task 2018-09-27T08:03:37.066Z] 08:03:37     INFO - queue closed
[task 2018-09-27T08:03:37.068Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.069Z] 08:03:37 CRITICAL - Traceback (most recent call last):
[task 2018-09-27T08:03:37.071Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.071Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/runtests.py", line 16, in <module>
[task 2018-09-27T08:03:37.072Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.073Z] 08:03:37 CRITICAL -     rv = wptrunner.main()
[task 2018-09-27T08:03:37.073Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.074Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 339, in main
[task 2018-09-27T08:03:37.074Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.075Z] 08:03:37 CRITICAL -     return start(**kwargs)
[task 2018-09-27T08:03:37.075Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.076Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 326, in start
[task 2018-09-27T08:03:37.077Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.078Z] 08:03:37 CRITICAL -     return not run_tests(**kwargs)
[task 2018-09-27T08:03:37.079Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.080Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 155, in run_tests
[task 2018-09-27T08:03:37.080Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.080Z] 08:03:37 CRITICAL -     **kwargs)
[task 2018-09-27T08:03:37.080Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.081Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 78, in get_loader
[task 2018-09-27T08:03:37.081Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.081Z] 08:03:37 CRITICAL -     skip_timeout=kwargs["skip_timeout"])
[task 2018-09-27T08:03:37.081Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.082Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 501, in __init__
[task 2018-09-27T08:03:37.082Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.083Z] 08:03:37 CRITICAL -     self._load_tests()
[task 2018-09-27T08:03:37.084Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.084Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 567, in _load_tests
[task 2018-09-27T08:03:37.085Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.085Z] 08:03:37 CRITICAL -     for test_path, test_type, test in self.iter_tests():
[task 2018-09-27T08:03:37.086Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.086Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 552, in iter_tests
[task 2018-09-27T08:03:37.087Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.088Z] 08:03:37 CRITICAL -     inherit_metadata, test_metadata = self.load_metadata(manifest_file, metadata_path, test_path)
[task 2018-09-27T08:03:37.089Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.090Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 535, in load_metadata
[task 2018-09-27T08:03:37.090Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.091Z] 08:03:37 CRITICAL -     metadata_path, test_path, test_manifest.url_base, self.run_info)
[task 2018-09-27T08:03:37.092Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.093Z] 08:03:37 CRITICAL -   File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/manifestexpected.py", line 301, in get_manifest
[task 2018-09-27T08:03:37.093Z] 08:03:37 CRITICAL - Test harness output was not a valid structured log message: 
[task 2018-09-27T08:03:37.094Z] 08:03:37 CRITICAL -     url_base=url_base)
Flags: needinfo?(jmaher)
sorry for the r+, web-platform-tests do not have a 'if true' condition.

instead we would need:
[fetch-canvas-tainting-video.https.html]
   disabled: https://bugzilla.mozilla.org/show_bug.cgi?id=1464541
Flags: needinfo?(jmaher) → needinfo?(ebalazs)
A new patch with the requested change.
Attachment #8985014 - Attachment is obsolete: true
Attachment #9012488 - Attachment is obsolete: true
Flags: needinfo?(ebalazs)
Attachment #9012512 - Flags: review?(jmaher)
Attachment #9012512 - Attachment is patch: true
Attachment #9012512 - Attachment mime type: application/octet-stream → text/plain
Comment on attachment 9012512 [details] [diff] [review]
Disable fetch-canvas-tainting-video.https.html on all platforms

Review of attachment 9012512 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks
Attachment #9012512 - Flags: review?(jmaher) → review+
Pushed by ebalazs@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/7e2070798ade
Disable fetch-canvas-tainting-video.https.html for frequent failures on all platform. r=jmaher
Keywords: checkin-needed
Can we close this as fixed?
Flags: needinfo?(jmaher)
thanks for checking, as this isn't fixed- it is a good idea to leave this bug open.
Flags: needinfo?(jmaher)
See Also: → 1464898
Severity: normal → S3

Bulk closing intermittent bugs for DOM LWS that have not seen new instances since at least 5 months.

Status: NEW → RESOLVED
Closed: 16 days ago
Resolution: --- → INCOMPLETE

Taking back the bulk change.

Status: RESOLVED → UNCONFIRMED
Ever confirmed: false
Resolution: INCOMPLETE → ---
Status: UNCONFIRMED → NEW
Ever confirmed: true
Keywords: leave-open
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: