Intermittent /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal

NEW
Unassigned
(NeedInfo from)

Status

()

defect
P5
normal
3 months ago
3 days ago

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

Tracking

(Regression, {intermittent-failure, leave-open, regression})

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [stockwell disabled])

Attachments

(2 attachments, 1 obsolete attachment)

Comment hidden (Intermittent Failures Robot)

15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | # AUDIT TASK RUNNER STARTED.
15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | > [buffer-stitching-1] Subsample buffer stitching, same rates
15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | Test 1: context.sampleRate is equal to 44100.
15:33:39 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal [0,0.06264832615852356,0.12505052983760834,0.18696144223213196,0.24813786149024963,0.308339387178421,0.36732956767082214,0.4248766303062439,0.4807544946670532,0.5347436666488647,0.5866319537162781,0.6362155675888062,0.683299720287323,0.7276993989944458,0.7692402005195618,0.8077588677406311...] with an element-wise tolerance of {"absoluteThreshold":0.000090957,"relativeThreshold":0}.
15:33:39 INFO - Index Actual Expected AbsError RelError Test threshold
15:33:39 INFO - [2003] -9.6732087433338165e-2 -9.6823699772357941e-2 9.1612339019775391e-5 9.4617680624852212e-4 9.0957000000000003e-5
15:33:39 INFO - [2004] -3.4187544137239456e-2 -3.4279607236385345e-2 9.2063099145889282e-5 2.6856520995424621e-3 9.0957000000000003e-5
15:33:39 INFO - [2005] 2.8491314500570297e-2 2.8398986905813217e-2 9.2327594757080078e-5 3.2510876202481997e-3 9.0957000000000003e-5
15:33:39 INFO - [2006] 9.1058239340782166e-2 9.0966261923313141e-2 9.1977417469024658e-5 1.0111157205356415e-3 9.0957000000000003e-5
15:33:39 INFO - [2007] 1.5326742827892303e-1 1.5317615866661072e-1 9.1269612312316895e-5 5.9584737668585898e-4 9.0957000000000003e-5
15:33:39 INFO - ...and 38033 more errors.
15:33:39 INFO - Max AbsError of 9.9816453440945740e-1 at index of 29994.
15:33:39 INFO - [29994] 1.5932920260919303e-10 9.9816453456878662e-1 9.9816453440945740e-1 9.9999999984037780e-1 9.0957000000000003e-5
15:33:39 INFO - Max RelError of 5.5714977262789269e+1 at index of 30419.
15:33:39 INFO - [30419] -1.4247581129893661e-3 -2.5121373255387880e-5 1.3996367397339782e-3 5.5714977262789269e+1 9.0957000000000003e-5
15:33:39 INFO - - assert_true: expected true got false
15:33:39 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
15:33:39 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
15:33:39 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
15:33:39 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
15:33:39 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
15:33:39 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
15:33:39 INFO - beCloseToArray@http://web-platform.test:8000/webaudio/resources/audit.js:1009:19
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:41:24
15:33:39 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
15:33:39 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13
15:33:39 INFO -
15:33:39 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X SNR (NaN dB) is not greater than or equal to 85.586. Got NaN. - assert_true: expected true got false
15:33:39 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
15:33:39 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
15:33:39 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
15:33:39 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
15:33:39 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
15:33:39 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
15:33:39 INFO - beGreaterThanOrEqualTo@http://web-platform.test:8000/webaudio/resources/audit.js:577:19
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:45:24
15:33:39 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
15:33:39 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13
15:33:39 INFO - .......

Component: web-platform-tests → Web Audio
Product: Testing → Core
Version: Version 3 → unspecified
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)

This has failed 90 times in the last 7 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-04-09&endday=2019-04-16&tree=trunk&bug=1533762

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=240459521&repo=autoland

[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | > [buffer-stitching-1] Subsample buffer stitching, same rates
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | Test 1: context.sampleRate is equal to 44100.
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal [0,0.06264832615852356,0.12505052983760834,0.18696144223213196,0.24813786149024963,0.308339387178421,0.36732956767082214,0.4248766303062439,0.4807544946670532,0.5347436666488647,0.5866319537162781,0.6362155675888062,0.683299720287323,0.7276993989944458,0.7692402005195618,0.8077588677406311...] with an element-wise tolerance of {"absoluteThreshold":0.000090957,"relativeThreshold":0}.
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - Index Actual Expected AbsError RelError Test threshold
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2003] -9.6732087433338165e-2 -9.6823699772357941e-2 9.1612339019775391e-5 9.4617680624852212e-4 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2004] -3.4187544137239456e-2 -3.4279607236385345e-2 9.2063099145889282e-5 2.6856520995424621e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2005] 2.8491314500570297e-2 2.8398986905813217e-2 9.2327594757080078e-5 3.2510876202481997e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2006] 9.1058239340782166e-2 9.0966261923313141e-2 9.1977417469024658e-5 1.0111157205356415e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2007] 1.5326742827892303e-1 1.5317615866661072e-1 9.1269612312316895e-5 5.9584737668585898e-4 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - ...and 38030 more errors.
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - Max AbsError of 9.3160665051180724e-1 at index of 43680.
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [43680] 1.5932920260919303e-10 -9.3160665035247803e-1 9.3160665051180724e-1 1.0000000001710263e+0 9.0957000000000003e-5
[task 2019-04-15T22:31:02.566Z] 22:31:02 INFO - Max RelError of 5.5714977262789269e+1 at index of 30419.
[task 2019-04-15T22:31:02.566Z] 22:31:02 INFO - [30419] -1.4247581129893661e-3 -2.5121373255387880e-5 1.3996367397339782e-3 5.5714977262789269e+1 9.0957000000000003e-5
[task 2019-04-15T22:31:02.567Z] 22:31:02 INFO - - assert_true: expected true got false
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - beCloseToArray@http://web-platform.test:8000/webaudio/resources/audit.js:1009:19
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:41:24
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13

Nils, could you please redirect this to someone who can take a look?

Flags: needinfo?(drno)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Whiteboard: [stockwell disable-recommended] → [stockwell needswork:owner]
Comment hidden (Intermittent Failures Robot)

Comment 15

2 months ago
Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/43e4cb12a099
Disable sub-sample-buffer-stitching.html on windows 7 and linux for frequent failures. r=jmaher
Keywords: leave-open
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Regressed by: 1532838

Probably not my fault, probably.

Bug 1532838 changes when minor GCs will occur, it could be changing timing, if this test relies on sensative timing then that's why it may look like a cause.

Flags: needinfo?(pbone)

I meant to add, if WebAudio people look at this and want to ask me questions about GC / Bug 1532838 then I'd be happy to help.

Comment hidden (Intermittent Failures Robot)

Comment 27

Last month
Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e28c51cc8100
Disable sub-sample-buffer-stitching.html on all desktop platforms r=jmaher
Comment hidden (Intermittent Failures Robot)
Attachment #9063672 - Attachment is obsolete: true
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
Comment hidden (Intermittent Failures Robot)
You need to log in before you can comment on or make changes to this bug.