1567706 - Intermittent TEST-UNEXPECTED-TIMEOUT | /feature-policy/reporting/encrypted-media-report-only.https.html | Encrypted Media report only mode - Test timed out

Status: NEW

(Core :: Audio/Video, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=257528171&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/Fz1dwioOQNCImztCHr1mnw/runs/0/artifacts/public/logs/live_backing.log

---

14:49:17 INFO - TEST-START | /feature-policy/reporting/encrypted-media-report-only.https.html
14:49:17 INFO - Clearing pref dom.security.featurePolicy.enabled
14:49:17 INFO - Clearing pref dom.security.featurePolicy.webidl.enabled
14:49:17 INFO - Clearing pref dom.reporting.featurePolicy.enabled
14:49:17 INFO - Clearing pref dom.vr.enabled
14:49:17 INFO - Clearing pref dom.payments.request.enabled
14:49:17 INFO - Clearing pref dom.reporting.enabled
14:49:17 INFO - Clearing pref dom.security.featurePolicy.header.enabled
14:49:17 INFO - Clearing pref dom.webmidi.enabled
14:49:17 INFO - Setting pref dom.security.featurePolicy.enabled (true)
14:49:17 INFO - Setting pref dom.security.featurePolicy.webidl.enabled (true)
14:49:17 INFO - Setting pref dom.reporting.featurePolicy.enabled (true)
14:49:17 INFO - Setting pref dom.vr.enabled (true)
14:49:18 INFO - Setting pref dom.payments.request.enabled (true)
14:49:18 INFO - Setting pref dom.reporting.enabled (true)
14:49:18 INFO - Setting pref dom.security.featurePolicy.header.enabled (true)
14:49:18 INFO - Setting pref dom.webmidi.enabled (true)
14:49:18 INFO - Closing window 15032385537
14:49:18 INFO - PID 5716 | [Child 8360, Chrome_ChildThread] WARNING: pipe error: 109: file z:/task_1563608939/build/src/ipc/chromium/src/chrome/common/ipc_channel[Parent 7956, Gecko_IOThread] WARNING: pipe error: 109: file z:/task_1563608939/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
14:49:18 INFO - PID 5716 | [Child 3404, Chrome_ChildThread] WARNING: pipe error: 109: file z:/task_1563608939/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
14:49:58 INFO -
14:49:58 INFO - TEST-UNEXPECTED-TIMEOUT | /feature-policy/reporting/encrypted-media-report-only.https.html | Encrypted Media report only mode - Test timed out
14:49:58 INFO - TEST-INFO | expected FAIL
14:49:58 INFO - TEST-UNEXPECTED-TIMEOUT | /feature-policy/reporting/encrypted-media-report-only.https.html | expected OK
14:49:58 INFO - TEST-INFO took 41036ms

Comment 1

[Intermittent Failures Robot]

11 failures in 4298 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11

Platform breakdown:

• windows10-aarch64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 2

[Razvan Maries]

It seems to be started on this merge: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-e10s-10%2Cw%28wpt10%29&revision=74908c04ec0ed6756ce2163e9392d18be0c8c3d2

Retriggers/Backfill:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-e10s-10%2Cw%28wpt10%29&tochange=74908c04ec0ed6756ce2163e9392d18be0c8c3d2&fromchange=ca1dbd076e1e47a8616ab6ee3e6fd4083d576857

Comment 3

[Intermittent Failures Robot]

36 failures in 4608 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 36

Platform breakdown:

• windows10-aarch64: 36

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 4

[Razvan Maries]

Attachment: Bug 1567706 - Disabled encrypted-media-report-only.https.html on Windows 10 aarch64. r=jmaher

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

can you backfill on the merge and figure out which test caused the failure?

Comment 6

[Razvan Maries]

Backfill: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception&enddate=2019-07-20&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-e10s-10%2Cw%28wpt10%29&tochange=74908c04ec0ed6756ce2163e9392d18be0c8c3d2&fromchange=d82871b98206b0f3c25f74e78e5ef52426570106

So far, I think https://bugzilla.mozilla.org/show_bug.cgi?id=1561774 caused the failures. I'm waiting for retriggers and will update the bug soon.

Comment 7

[Daniel Varga [:dvarga]]

rmaries was right, this started after Bug 1561774 got landed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-e10s-10%2Cw%28wpt10%29&revision=05ecec42602f0dad6bb97d631eeed7b3fd1812e1

Retriggers :
https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception&enddate=2019-07-20&searchStr=windows%2C10%2Caarch64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-aarch64%2Fopt-web-platform-tests-e10s-10%2Cw%28wpt10%29&tochange=74908c04ec0ed6756ce2163e9392d18be0c8c3d2&fromchange=06d63484944923623e2f5e500df313b97e694348&selectedJob=259018758

mshal: Can you please take a look at this?

Comment 8

[Michael Shal [:mshal]]

I'm not really sure what this test does -- jmaher, do you have any suggestions here? Or who else I could bug for help? :)

Before my patch, the tests ran on win64-aarch64/opt, and after my patch, they run on win64-aarch64-shippable/opt, which itself is comprised of win32-shippable/opt and win64-aarch64-shippable-no-eme/opt. So I guess previously it was using EME from the win64 build, and now it's failing with EME from the win32 part of the build?

I'm also a little confused by the test manifest, since the failing test shows:

INFO - TEST-UNEXPECTED-TIMEOUT | /feature-policy/reporting/encrypted-media-report-only.https.html | Encrypted Media report only mode - Test timed out
INFO - TEST-UNEXPECTED-TIMEOUT | /feature-policy/reporting/encrypted-media-report-only.https.html | expected OK

but the test manifest has:

[encrypted-media-report-only.https.html]
  expected:
    if (os == "android") and not e10s: OK
    if (os == "win") and (processor == "aarch64"): OK
    if (os == "android") and e10s: OK
    TIMEOUT
  [Encrypted Media report only mode]
    expected:
      if (os == "android") and not e10s: FAIL
      if (os == "win") and (processor == "aarch64"): FAIL
      if (os == "android") and e10s: FAIL
      TIMEOUT

To me it looks like for the "Encrypted Media report only mode", we are expecting FAIL for win/aarch64, but the error message says it is expecting OK (and the previous build gets OK).

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

My understanding of eme and what we are doing for aarch64 is lacking. I don't understand what was running before in opt and now what is running in shippable. I assume whatever we build and test is what we ship and we should be able to support EME.

:ajones, do you know who could help answer this?

Comment 10

[Intermittent Failures Robot]

31 failures in 4439 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 31

Platform breakdown:

• windows10-aarch64: 31

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/9fa080a464cb
Disabled encrypted-media-report-only.https.html on Windows 10 aarch64. r=jmaher

Comment 12

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/9fa080a464cb

Comment 13

[Intermittent Failures Robot]

49 failures in 4666 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #39 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 48
• try: 1

Platform breakdown:

• windows10-aarch64: 49

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 14

[Dorel Luca [:dluca]]

This bug failed 44 times in the last 7 days. Occurs on windows10-aarch64 on opt build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=262198993&repo=mozilla-central&lineNumber=4873

Comment 15

[Intermittent Failures Robot]

44 failures in 4839 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 44

Platform breakdown:

• windows10-aarch64: 44

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 16

[Dorel Luca [:dluca]]

Attachment: Bug 1567706 - Update expectations for encrypted-media-report-only.https.html r=jmaher

Comment 17

[Dorel Luca [:dluca]]

Try push for the patch I added.

https://treeherder.mozilla.org/#/jobs?repo=try&revision=a54da5e6edd20b2d4138a98ed67c264296615497&selectedJob=262713202

Comment 18

[Intermittent Failures Robot]

40 failures in 5073 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 39
• try: 1

Platform breakdown:

• windows10-aarch64: 40

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/166dc4cccabd
Update expectations for encrypted-media-report-only.https.html r=jgraham

Comment 20

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/166dc4cccabd

Comment 21

[Intermittent Failures Robot]

5 failures in 5047 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform breakdown:

• windows10-aarch64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1567706&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 22

[Paul Adenot (:padenot)]

dluca, anything you want to do here? Should we remove the leave-open tag maybe ?

Comment 23

[Dorel Luca [:dluca]]

Paul: I only updated the expectation in that patch, I wouldn't say the bug is fixed because of that.
I don't think removing the tag would help the bug getting fixed.