1552818 - Intermittent dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "inactive-pause", expected "active" l | Corrrect audible state - got "active", expected "inactive-nonaudible"

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, defect)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=247331889&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/KF4-bJ15Tcy_KFoks1Solw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-05-20T12:10:17.567Z] 12:10:17 INFO - TEST-START | dom/base/test/test_audioNotificationSilent_audioFile.html
[task 2019-05-20T12:10:17.686Z] 12:10:17 INFO - TEST-INFO | started process screentopng
[task 2019-05-20T12:10:18.282Z] 12:10:18 INFO - TEST-INFO | screentopng: exit 0
[task 2019-05-20T12:10:18.283Z] 12:10:18 INFO - Buffered messages logged at 12:10:17
[task 2019-05-20T12:10:18.284Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer set
[task 2019-05-20T12:10:18.284Z] 12:10:18 INFO - Audio playing start
[task 2019-05-20T12:10:18.285Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
[task 2019-05-20T12:10:18.286Z] 12:10:18 INFO - Buffered messages finished
[task 2019-05-20T12:10:18.286Z] 12:10:18 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "inactive-pause", expected "active"
[task 2019-05-20T12:10:18.287Z] 12:10:18 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
[task 2019-05-20T12:10:18.287Z] 12:10:18 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
[task 2019-05-20T12:10:18.289Z] 12:10:18 INFO - Audio would become silent during playing
[task 2019-05-20T12:10:18.290Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
[task 2019-05-20T12:10:18.290Z] 12:10:18 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-05-20T12:10:18.291Z] 12:10:18 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "active", expected "inactive-nonaudible"
[task 2019-05-20T12:10:18.292Z] 12:10:18 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
[task 2019-05-20T12:10:18.292Z] 12:10:18 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer removed
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - GECKO(5378) | MEMORY STAT | vsize 2754MB | residentFast 176MB | heapAllocated 30MB
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - TEST-OK | dom/base/test/test_audioNotificationSilent_audioFile.html | took 160ms

Comment 1

[Intermittent Failures Robot]

5 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• try: 2

Platform breakdown:

• linux64-shippable-qr: 1
• android-em-7-0-x86_64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 2

[Intermittent Failures Robot]

6 failures in 4337 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 3

[Intermittent Failures Robot]

6 failures in 5197 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 4

[Intermittent Failures Robot]

5 failures in 4753 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 1
• mozilla-central: 1
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 4
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 5

[Intermittent Failures Robot]

2 failures in 2581 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 6

[Andreea Pavel [:apavel]]

Edwin can you take a look at this? I believe it's from bug 1555454

https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=os%2Cx%2C10.14%2Cdebug%2Cmochitests%2Ctest-macosx1014-64%2Fdebug-mochitest-e10s-1%2Cm%281%29&tochange=a914cf0cb9362d6b8f55ad1dce5660d838cb09bd&fromchange=be82b2bd60e53730ff880428f17000df9c5af047&selectedJob=253699217

There are 42 total failures in the last 4 days on macosx1014-64 debug and macosx1014-64-shippable opt.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=253829368&repo=autoland&lineNumber=3509

00:06:04 INFO - TEST-START | dom/base/test/test_audioNotificationSilent_audioFile.html
00:06:04 INFO - TEST-INFO | started process screencapture
00:06:04 INFO - TEST-INFO | screencapture: exit 0
00:06:04 INFO - Buffered messages logged at 00:06:04
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer set
00:06:04 INFO - Audio playing start
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
00:06:04 INFO - Buffered messages finished
00:06:04 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "inactive-pause", expected "active"
00:06:04 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
00:06:04 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
00:06:04 INFO - Audio would become silent during playing
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
00:06:04 INFO - Not taking screenshot here: see the one that was previously logged
00:06:04 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "active", expected "inactive-nonaudible"
00:06:04 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
00:06:04 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer removed
00:06:04 INFO - GECKO(1851) | MEMORY STAT | vsize 7281MB | residentFast 127MB | heapAllocated 32MB
00:06:04 INFO - TEST-OK | dom/base/test/test_audioNotificationSilent_audioFile.html | took 174ms

Comment 7

[Intermittent Failures Robot]

17 failures in 792 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 1
• try: 1
• mozilla-inbound: 2

Platform breakdown:

• macosx1014-64-shippable: 4
• macosx1014-64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-27&endday=2019-06-27&tree=all

Comment 8

[Edwin Takahashi (:egao | infrequent contributor)]

:alwu - I see that you added this test back in 2016. We are seeing higher than expected intermittent rate for this test on macosx1014 platform. Could you take a look, or point to someone that may know about this test? In the meantime, I am proposing to disable this test on macosx1014.

Comment 9

[Alastor Wu [:alwu]]

Sure, I can take a look on it. Keep NI.

Comment 10

[Intermittent Failures Robot]

29 failures in 815 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-inbound: 10
• try: 2

Platform breakdown:

• macosx1014-64: 20
• macosx1014-64-shippable: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-28&endday=2019-06-28&tree=all

Comment 11

[Intermittent Failures Robot]

85 failures in 4409 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #25 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 58
• mozilla-inbound: 20
• mozilla-central: 3
• try: 4

Platform breakdown:

• macosx1014-64: 59
• macosx1014-64-shippable: 25
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 12

[Alastor Wu [:alwu]]

Attachment: Bug 1552818 - part1 : prevent to leak audio-playback notification.

This test will leak one audio-playback notification to next test, because when we close this test, we would close iframe and send the inaudible-pause notification.

It would somehow affect the following test if the next one is also listening the audio-playback notification.

Comment 13

[Alastor Wu [:alwu]]

Attachment: Bug 1552818 - part2 : refactor test 'test_audioNotificationNavigationWebAudio.html' by using async-await form.

Using async and await form can increase the readability of the test.

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e56260118399
part1 : prevent to leak audio-playback notification. r=padenot
https://hg.mozilla.org/integration/autoland/rev/e349eb0585f7
part2 : refactor test 'test_audioNotificationNavigationWebAudio.html' by using async-await form. r=padenot

Comment 15

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/e56260118399
https://hg.mozilla.org/mozilla-central/rev/e349eb0585f7

Comment 16

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

Comment 17

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

Comment 18

[Intermittent Failures Robot]

21 failures in 3501 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 4
• mozilla-inbound: 3
• try: 1

Platform breakdown:

• macosx1014-64: 14
• macosx1014-64-shippable: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1552818&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 19

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

Test-only change needed to run OSX 10.14 tests on ESR68. Approved for 68.1esr.

Comment 20

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-esr68/rev/0ddbde0b74fb
https://hg.mozilla.org/releases/mozilla-esr68/rev/16410020f7e1