1708777 - Intermittent macOS mda dom/media/test/<test-name> | * Failed to create MediaKeys object.

Status: RESOLVED FIXED

(Core :: Audio/Video: Playback, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=338322272&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FLD3-ujaQIWRMvv9fk1VXg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-04-30T16:37:23.272Z] 16:37:23     INFO - TEST-PASS | dom/media/test/test_eme_autoplay.html | isEncrypted should not be accessible from content 
[task 2021-04-30T16:37:23.273Z] 16:37:23     INFO - [16:37:23.125] bipbop 10s-0 got encrypted(cenc, 0000003470737368010000001077efecc0b24d02ace33c1e52e2fb4b000000017e571d037e571d037e571d037e571d1100000000) event.
[task 2021-04-30T16:37:23.274Z] 16:37:23     INFO - [16:37:23.126] bipbop 10s-0 video: updateend for bipbop-cenc-video-10s.mp4, SourceBuffer{AppendMode=-, updating=false, buffered=0-10.01, audioTracks=-, videoTracks=-}
[task 2021-04-30T16:37:23.275Z] 16:37:23     INFO - [16:37:23.126] bipbop 10s-0 video: end of track
[task 2021-04-30T16:37:23.276Z] 16:37:23     INFO - [16:37:23.126] bipbop 10s-0 Tracks loaded, calling MediaSource.endOfStream()
[task 2021-04-30T16:37:23.276Z] 16:37:23     INFO - Buffered messages finished
[task 2021-04-30T16:37:23.277Z] 16:37:23     INFO - TEST-UNEXPECTED-FAIL | dom/media/test/test_eme_autoplay.html | bipbop 10s-0 Failed to create MediaKeys object. 
[task 2021-04-30T16:37:23.278Z] 16:37:23     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-30T16:37:23.278Z] 16:37:23     INFO - startTest/<@https://example.com/tests/dom/media/test/test_eme_autoplay.html:105:22
[task 2021-04-30T16:37:23.278Z] 16:37:23     INFO - [finished bipbop 10s-0] remaining= 
[task 2021-04-30T16:37:23.279Z] 16:37:23     INFO - TEST-PASS | dom/media/test/test_eme_autoplay.html | [finished bipbop 10s-0 t=0.271] Length of array should match number of running tests ```

Comment 5

[Cosmin Sabou [:CosminS]]

Marco, retriggers point to Bug 1707950 as where the failures started: https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&selectedTaskRun=BTDfc17tQ2WUH0KvfTGCGw.0&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&searchStr=os%2Cx%2C10.14%2Cwebrender%2Cdebug%2Cmochitests%2Cwith%2Csocket%2Cprocess%2Ctest-macosx1014-64-qr%2Fdebug-mochitest-media-spi-e10s%2C&fromchange=7e540a4e432f9b3b21e9e2152084add6bbe61d7c&tochange=82e6e380d9a4bd8bd6c20f1f4006884d80d21226
They fail only on macosx1014-64, mostly on debug builds. https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2021-04-25&endday=2021-05-02&tree=trunk&bug=1708777
Failure log: https://treeherder.mozilla.org/logviewer?job_id=338434184&repo=autoland
Could you please have a look over these failures? Thank you.

Comment 6

[Marco Bonardo [:mak] (Away 10-21 August)]

I'm sorry but I have no idea how replacing an icon may cause such a failure, I suspect it's just a microtiny time shift, or there are external causes. The media team can have more luck than me investigating this.

Comment 7

[Andreea Pavel [:apavel]]

Hi Paul, can you please take a look?

Comment 8

[Intermittent Failures Robot]

22 failures in 3706 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 9
• try: 1

Platform and build breakdown:

• macosx1014-64-qr: 17
  • opt: 5
  • debug: 12
• macosx1014-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1707950

Comment 12

[Intermittent Failures Robot]

21 failures in 659 pushes (0.032 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• try: 1
• mozilla-central: 4

Platform and build breakdown:

• macosx1014-64-qr: 13
  • opt: 5
  • debug: 8
• macosx1014-64-shippable-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-03&endday=2021-05-03&tree=all

Comment 13

[Intermittent Failures Robot]

39 failures in 641 pushes (0.061 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 31
• mozilla-central: 4
• try: 4

Platform and build breakdown:

• macosx1014-64-qr: 30
  • debug: 10
  • opt: 20
• macosx1014-64-shippable-qr: 4
  • opt: 4
• macosx1014-64-devedition-qr: 3
  • opt: 3
• windows10-64-qr: 1
  • opt: 1
• windows10-64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-04&endday=2021-05-04&tree=all

Comment 14

[Intermittent Failures Robot]

17 failures in 627 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 6
• try: 1

Platform and build breakdown:

• macosx1014-64-qr: 10
  • debug: 7
  • opt: 3
• macosx1014-64-shippable-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-05&endday=2021-05-05&tree=all

Comment 16

[Intermittent Failures Robot]

22 failures in 633 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 4
• try: 1

Platform and build breakdown:

• macosx1014-64-qr: 17
  • debug: 8
  • opt: 9
• macosx1014-64-shippable-qr: 4
  • opt: 4
• macosx1014-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-06&endday=2021-05-06&tree=all

Comment 17

[Intermittent Failures Robot]

19 failures in 547 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 3
• try: 1

Platform and build breakdown:

• macosx1014-64-qr: 16
  • debug: 10
  • opt: 6
• linux1804-64: 1
  • debug: 1
• macosx1014-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-07&endday=2021-05-07&tree=all

Comment 18

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 119 failures within the last 7 days, on OS X 10.14 WebRender Shippable opt/debug and on OS X 10.14 WebRender opt/debug.

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=339117231&repo=autoland&lineNumber=30417

[task 2021-05-08T00:36:57.702Z] 00:36:57     INFO - Buffered messages logged at 00:36:57
[task 2021-05-08T00:36:57.703Z] 00:36:57     INFO - [00:36:57.539] bipbop 10s-0 video: fetch of bipbop-cenc-video-10s.mp4 complete, appending
[task 2021-05-08T00:36:57.703Z] 00:36:57     INFO - [00:36:57.559] bipbop 10s-0 got encrypted(cenc, 0000003470737368010000001077efecc0b24d02ace33c1e52e2fb4b000000017e571d037e571d037e571d037e571d1100000000) event.
[task 2021-05-08T00:36:57.704Z] 00:36:57     INFO - [00:36:57.561] bipbop 10s-0 video: updateend for bipbop-cenc-video-10s.mp4, SourceBuffer{AppendMode=-, updating=false, buffered=0-10.01, audioTracks=-, videoTracks=-}
[task 2021-05-08T00:36:57.704Z] 00:36:57     INFO - [00:36:57.562] bipbop 10s-0 video: end of track
[task 2021-05-08T00:36:57.705Z] 00:36:57     INFO - [00:36:57.562] bipbop 10s-0 Tracks loaded, calling MediaSource.endOfStream()
[task 2021-05-08T00:36:57.705Z] 00:36:57     INFO - Buffered messages finished
[task 2021-05-08T00:36:57.706Z] 00:36:57     INFO - TEST-UNEXPECTED-FAIL | dom/media/test/test_eme_detach_reattach_same_mediakeys_during_playback.html | bipbop 10s-0 Failed to create MediaKeys object. 
[task 2021-05-08T00:36:57.706Z] 00:36:57     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-05-08T00:36:57.706Z] 00:36:57     INFO - startTest/<@https://example.com/tests/dom/media/test/test_eme_detach_reattach_same_mediakeys_during_playback.html:132:22
[task 2021-05-08T00:39:56.671Z] 00:39:56     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-05-08T00:39:56.672Z] 00:39:56     INFO - TEST-UNEXPECTED-FAIL | dom/media/test/test_eme_detach_reattach_same_mediakeys_during_playback.html | Test timed out! 
[task 2021-05-08T00:39:56.672Z] 00:39:56     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-05-08T00:39:56.673Z] 00:39:56     INFO - onTimeout@https://example.com/tests/dom/media/test/manifest.js:2211:9
[task 2021-05-08T00:39:56.673Z] 00:39:56     INFO - bipbop 10s-0 timed out!
[task 2021-05-08T00:39:56.673Z] 00:39:56     INFO - [finished bipbop 10s-0] remaining=

Comment 19

[Narcis Beleuzu [:NarcisB]]

:jkew , I did a few retriggers and the failure seems to start from Bug 1707655. Can you please take a look?

Retriggers:
https://treeherder.mozilla.org/jobs?repo=autoland&searchStr=os%2Cx%2C10.14%2Cwebrender%2Cshippable%2Copt%2Cmochitests%2Cwith%2Cwebgl%2Cover%2Cipc%2Ctest-macosx1014-64-shippable-qr%2Fopt-mochitest-media-gli-e10s%2Cmda1&tochange=16eddcf3458b3609ec1763218c1b015d9eeb91c5&fromchange=7e540a4e432f9b3b21e9e2152084add6bbe61d7c&selectedTaskRun=baGM1HVMR9y_he8X8SW1wQ.0

Comment 20

[Intermittent Failures Robot]

128 failures in 3279 pushes (0.039 failures/push) were associated with this bug in the last 7 days.

This is the #2 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 99
• try: 8
• mozilla-central: 21

Platform and build breakdown:

• macosx1014-64-qr: 99
  • opt: 50
  • debug: 49
• macosx1014-64-shippable-qr: 25
  • opt: 25
• macosx1014-64-devedition-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 21

[Jonathan Kew [:jfkthame]]

I don't see any reason bug 1707655 would have directly affected media behavior, but it did certainly affect timing of browser startup, so if the test is quite sensitive to timing that could explain why the failures started appearing.

As it happens, we're probably going to revert the change in startup/timing behavior for 10.14 in bug 1708821, so that may resolve the issue here. Let's see what happens after that is reviewed/landed.

Comment 22

[Paul Adenot (:padenot)]

No idea really. This looks really flaky indeed. Bryce might know more (because this is EME-related) but is currently really busy (on important EME-related things).

Comment 23

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

I'm monitoring this and a few other EME related upticks (see https://bugzilla.mozilla.org/show_bug.cgi?id=1708862#c2) to see if bug 1708821 has any impact. My understanding is there's also some infra changes and we expect tom migrate away from 10.14. I don't have a clear reason why these tests are now failing, but if they continue to do so after the above changes I can dedicate more time to investigate.

Comment 24

[Intermittent Failures Robot]

19 failures in 522 pushes (0.036 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 16
• mozilla-central: 3

Platform and build breakdown:

• macosx1014-64-qr: 15
  • debug: 12
  • opt: 3
• macosx1014-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1708777&startday=2021-05-10&endday=2021-05-10&tree=all

Comment 25

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

No new failures for the last 24h - seems to be fixed by bug 1708821.