1546756 - Intermittent /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html | All data processed correctly - assert_array_approx_equals: comparing expected and rendered buffers (channel 0)

Status: RESOLVED FIXED

(Core :: Web Audio, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: cbrindusan [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=242346781&repo=autoland

https://queue.taskcluster.net/v1/task/aHggeZ18TeyDV3PNDnrOZQ/runs/0/artifacts/public/logs/live_backing.log

17:02:57 INFO - TEST-START | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/cors-check.https.html
17:02:57 INFO - Setting pref dom.worklet.enabled (true)
17:02:57 INFO - Setting pref privacy.reduceTimerPrecision (false)
17:02:57 INFO - Setting pref dom.audioworklet.enabled (true)
17:02:58 INFO - PID 5371 | JavaScript error: https://web-platform.test:8443/webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/cors-check.https.html, line 51: NS_ERROR_NOT_IMPLEMENTED
17:03:08 INFO - ....
17:03:08 INFO - TEST-TIMEOUT | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/cors-check.https.html | took 10753ms
17:03:08 INFO - TEST-START | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html
17:03:08 INFO - Clearing pref dom.worklet.enabled
17:03:08 INFO - Clearing pref privacy.reduceTimerPrecision
17:03:08 INFO - Clearing pref dom.audioworklet.enabled
17:03:08 INFO - Setting pref dom.worklet.enabled (true)
17:03:08 INFO - Setting pref privacy.reduceTimerPrecision (false)
17:03:08 INFO - Setting pref dom.audioworklet.enabled (true)
17:03:08 INFO - Closing window 6442450945
17:03:10 INFO -
17:03:10 INFO - TEST-PASS | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html | Element Source tests completed
17:03:10 INFO - TEST-PASS | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html | Channel 0 processed some data
17:03:10 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html | All data processed correctly - assert_array_approx_equals: comparing expected and rendered buffers (channel 0) lengths differ, expected 44098 got 43587

Comment 1

[Intermittent Failures Robot]

3 failures in 3031 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 2

Platform breakdown:

• osx-10-10-shippable: 1
• android-em-7-0-x86: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 2

[Intermittent Failures Robot]

9 failures in 4131 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 4

Platform breakdown:

• windows7-32-shippable: 3
• windows10-aarch64: 1
• android-em-7-0-x86: 3
• osx-10-10-shippable: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 3

[Intermittent Failures Robot]

8 failures in 4705 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• mozilla-inbound: 2
• autoland: 1
• try: 1

Platform breakdown:

• osx-10-10-shippable: 3
• android-em-7-0-x86: 3
• windows7-32-shippable: 1
• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 4658 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2

Platform breakdown:

• macosx1010-64-devedition: 1
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 5

[Intermittent Failures Robot]

12 failures in 4730 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• mozilla-beta: 1
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 8
• macosx1010-64-devedition: 1
• android-em-7-0-x86: 2
• macosx1010-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 6

[Intermittent Failures Robot]

12 failures in 4337 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 9
• autoland: 1
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 10
• macosx1010-64-shippable: 1
• macosx1010-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 7

[Intermittent Failures Robot]

33 failures in 5197 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 9
• try: 2
• autoland: 15
• mozilla-inbound: 5

Platform breakdown:

• macosx1010-64-shippable: 15
• android-em-7-0-x86_64: 8
• android-em-7-0-x86: 1
• windows7-32-devedition: 1
• macosx1014-64-shippable: 6
• macosx1014-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 8

[Intermittent Failures Robot]

36 failures in 4753 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #50 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• try: 5
• mozilla-inbound: 7
• mozilla-central: 3
• mozilla-beta: 2

Platform breakdown:

• macosx1014-64-shippable: 14
• macosx1014-64: 15
• android-em-7-0-x86_64: 4
• linux64-shippable-qr: 2
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 9

[Intermittent Failures Robot]

51 failures in 2581 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #39 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 28
• mozilla-inbound: 8
• mozilla-central: 11
• mozilla-beta: 1
• try: 3

Platform breakdown:

• macosx1014-64-shippable: 12
• android-em-7-0-x86_64: 17
• macosx1014-64: 15
• linux64-shippable-qr: 1
• windows10-64-shippable: 3
• windows10-64: 1
• macosx1014-64-devedition: 1
• android-em-7-0-x86: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 10

[Intermittent Failures Robot]

64 failures in 4409 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #39 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 38
• mozilla-central: 8
• try: 4
• mozilla-inbound: 13
• mozilla-beta: 1

Platform breakdown:

• android-em-7-0-x86_64: 36
• windows10-64-shippable: 1
• macosx1014-64-shippable: 15
• macosx1014-64: 11
• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 11

[Andreea Pavel [:apavel]]

Attachment: Bug 1546756 - disabled mediaElementAudioSourceToScriptProcessorTest.html on android debug r=jmaher

Comment 12

[Andreea Pavel [:apavel]]

Nils can you assign someone to look at this?

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bce811ca3316
disabled mediaElementAudioSourceToScriptProcessorTest.html on android debug r=jmaher

Comment 14

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/bce811ca3316

Comment 15

[Intermittent Failures Robot]

57 failures in 3501 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 36
• mozilla-inbound: 12
• try: 5
• mozilla-central: 4

Platform breakdown:

• android-em-7-0-x86_64: 26
• macosx1014-64-shippable: 14
• macosx1014-64: 15
• linux64-shippable: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 16

[Daniel Varga [:dvarga]]

In the last 7 days there were 60 failures associated with this bug: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-07-05&endday=2019-07-12&tree=all&bug=1546756
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=256068056&repo=mozilla-inbound&lineNumber=7285
Occurs on android-em-7-0-x86_64, macosx1014-64, macosx1014-64-shippable, windows10-64 build type.

Comment 17

[Intermittent Failures Robot]

56 failures in 4710 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 32
• mozilla-inbound: 10
• try: 5
• mozilla-central: 6
• mozilla-beta: 1
• mozilla-esr68: 1
• oak: 1

Platform breakdown:

• android-em-7-0-x86_64: 31
• macosx1014-64-shippable: 16
• windows10-64-shippable: 3
• macosx1014-64: 2
• macosx1010-64-shippable: 1
• windows10-64: 2
• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 18

[Andreea Pavel [:apavel]]

Hi Joel, this is still mostly failing on Android debug, can you please take a look?

Comment 19

[Joel Maher ( :jmaher ) (UTC -8)]

I am really confused by this, looking at a recent android/debug failure
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=256285677&repo=mozilla-inbound&lineNumber=7315

I see this as the summary of what conditions we have:
https://taskcluster-artifacts.net/AVMCFz6HTcurpxKirJ8DAg/0/public/test_info//wptreport.json

os = 'android'
debug = true

so I am confused why the change we made ~2 weeks ago is failing:
if (os == "android") and debug

I did find the problem, we are not disabling anything here, because of a typo:
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html.ini#2

we have:
disbled

instead of:
disabled

Comment 20

[Andreea Pavel [:apavel]]

Attachment: Bug 1546756 - fix disabling typo r=jmaher

Comment 21

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3f6a90f67975
fix disabling typo r=jmaher

Comment 22

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/3f6a90f67975

Comment 23

[Intermittent Failures Robot]

19 failures in 4298 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1
• mozilla-beta: 11
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 7
• windows10-64-shippable: 2
• macosx1014-64-devedition: 2
• macosx1014-64: 3
• macosx1014-64-shippable: 3
• windows10-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 24

[Intermittent Failures Robot]

13 failures in 4608 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 4
• mozilla-inbound: 1
• mozilla-esr68: 2
• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 6
• macosx1014-64: 1
• android-em-7-0-x86_64: 3
• macosx1014-64-shippable: 2
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 25

[Intermittent Failures Robot]

6 failures in 4439 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 6

Platform breakdown:

• android-em-7-0-x86_64: 2
• macosx1014-64-devedition: 1
• macosx1014-64-shippable: 1
• windows10-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 26

[Intermittent Failures Robot]

2 failures in 4666 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• try: 1

Platform breakdown:

• macosx1014-64-devedition: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 27

[Intermittent Failures Robot]

8 failures in 4839 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 8

Platform breakdown:

• macosx1014-64-devedition: 2
• android-em-7-0-x86_64: 1
• macosx1014-64: 4
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 28

[Intermittent Failures Robot]

10 failures in 5073 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 8
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 4
• macosx1014-64: 3
• macosx1014-64-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 29

[Intermittent Failures Robot]

3 failures in 5047 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-esr68: 2

Platform breakdown:

• android-em-7-0-x86_64: 1
• macosx1014-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 30

[Intermittent Failures Robot]

4 failures in 4637 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-release: 3

Platform breakdown:

• windows10-64: 1
• macosx1014-64-shippable: 2
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 4350 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 32

[Intermittent Failures Robot]

2 failures in 4292 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1
• mozilla-release: 1

Platform breakdown:

• macosx1014-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 3801 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-10-07&endday=2019-10-13&tree=all

Comment 34

[Intermittent Failures Robot]

3 failures in 4314 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3

Platform breakdown:

• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 35

[Andreas Pehrson [:pehrsons]]

Attachment: Bug 1546756 - Update WPT expectations following bug 1172394. r?padenot

mediaElementAudioSourceToScriptProcessorTest creates an AudioContext at sample
rate 44100, but that might not be the default cubeb rate on some platforms. If
it isn't, we end up with two MediaTrackGraphs for the same window, with one
being fed by the media element, and the other running the script processor node.
It's when this happens that we only get 0 on the output. We force the preferred
cubeb rate to 44100 for this test, so we at least keep the test coverage of the
media element source node.

This became permafail with bug 1172394, whereas before it was intermittent.
Unclear why.

Depends on D52049

Comment 36

[Intermittent Failures Robot]

1 failures in 4850 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2019-11-04&endday=2019-11-10&tree=all

Comment 37

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3ff0d72d23a2
Update WPT expectations following bug 1172394. r=padenot

Comment 38

[Natalia Csoregi [:nataliaCs]]

Backed out for failures on browser_disabledForMediaStreamVideos.js see Bug 1172394

Comment 39

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a26e7fcb649a
Update WPT expectations following bug 1172394. r=padenot

Comment 40

[Razvan Maries]

https://hg.mozilla.org/mozilla-central/rev/a26e7fcb649a

Comment 41

[Andreas Pehrson [:pehrsons]]

Ah, I didn't intend to leave this open.

Comment 42

[Andreas Pehrson [:pehrsons]]

Seems like the bot looked at the first patch on the bug, when it probably should have looked at the most recent one.

Comment 43

[Sylvestre Ledru [:Sylvestre]]

Maybe? but afaik, this is a pretty rare case (it has been in production for a while and this is the first time that I saw this), not sure it is worth the time :)

Comment 44

[Andreas Pehrson [:pehrsons]]

Sure. Up to your judgment.

Comment 45

[Sylvestre Ledru [:Sylvestre]]

thanks!
if you see this pattern more often, please let me know!

Comment 46

[Intermittent Failures Robot]

1 failures in 4955 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 47

[Intermittent Failures Robot]

1 failures in 4773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 48

[Intermittent Failures Robot]

1 failures in 5423 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546756&startday=2020-04-27&endday=2020-05-03&tree=all