Open Bug 1533762 Opened 5 years ago Updated 2 years ago

Intermittent /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal

Categories

(Core :: Web Audio, defect, P5)

Product:
Core
Component:
Web Audio
Type:
defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, leave-open, regression, Whiteboard: [stockwell disabled])

Attachments

(2 files, 1 obsolete file)

Bug 1533762 - Disable sub-sample-buffer-stitching.html on windows 7 and linux for frequent failures.
47 bytes, text/x-phabricator-request
Details | Review
Bug 1533762 - Disable sub-sample-buffer-stitching.html on all desktop platforms
47 bytes, text/x-phabricator-request
Details | Review

15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | # AUDIT TASK RUNNER STARTED.
15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | > [buffer-stitching-1] Subsample buffer stitching, same rates
15:33:39 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | Test 1: context.sampleRate is equal to 44100.
15:33:39 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal [0,0.06264832615852356,0.12505052983760834,0.18696144223213196,0.24813786149024963,0.308339387178421,0.36732956767082214,0.4248766303062439,0.4807544946670532,0.5347436666488647,0.5866319537162781,0.6362155675888062,0.683299720287323,0.7276993989944458,0.7692402005195618,0.8077588677406311...] with an element-wise tolerance of {"absoluteThreshold":0.000090957,"relativeThreshold":0}.
15:33:39 INFO - Index Actual Expected AbsError RelError Test threshold
15:33:39 INFO - [2003] -9.6732087433338165e-2 -9.6823699772357941e-2 9.1612339019775391e-5 9.4617680624852212e-4 9.0957000000000003e-5
15:33:39 INFO - [2004] -3.4187544137239456e-2 -3.4279607236385345e-2 9.2063099145889282e-5 2.6856520995424621e-3 9.0957000000000003e-5
15:33:39 INFO - [2005] 2.8491314500570297e-2 2.8398986905813217e-2 9.2327594757080078e-5 3.2510876202481997e-3 9.0957000000000003e-5
15:33:39 INFO - [2006] 9.1058239340782166e-2 9.0966261923313141e-2 9.1977417469024658e-5 1.0111157205356415e-3 9.0957000000000003e-5
15:33:39 INFO - [2007] 1.5326742827892303e-1 1.5317615866661072e-1 9.1269612312316895e-5 5.9584737668585898e-4 9.0957000000000003e-5
15:33:39 INFO - ...and 38033 more errors.
15:33:39 INFO - Max AbsError of 9.9816453440945740e-1 at index of 29994.
15:33:39 INFO - [29994] 1.5932920260919303e-10 9.9816453456878662e-1 9.9816453440945740e-1 9.9999999984037780e-1 9.0957000000000003e-5
15:33:39 INFO - Max RelError of 5.5714977262789269e+1 at index of 30419.
15:33:39 INFO - [30419] -1.4247581129893661e-3 -2.5121373255387880e-5 1.3996367397339782e-3 5.5714977262789269e+1 9.0957000000000003e-5
15:33:39 INFO - - assert_true: expected true got false
15:33:39 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
15:33:39 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
15:33:39 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
15:33:39 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
15:33:39 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
15:33:39 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
15:33:39 INFO - beCloseToArray@http://web-platform.test:8000/webaudio/resources/audit.js:1009:19
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:41:24
15:33:39 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
15:33:39 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13
15:33:39 INFO -
15:33:39 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X SNR (NaN dB) is not greater than or equal to 85.586. Got NaN. - assert_true: expected true got false
15:33:39 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
15:33:39 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
15:33:39 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
15:33:39 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
15:33:39 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
15:33:39 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
15:33:39 INFO - beGreaterThanOrEqualTo@http://web-platform.test:8000/webaudio/resources/audit.js:577:19
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:45:24
15:33:39 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
15:33:39 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
15:33:39 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
15:33:39 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13
15:33:39 INFO - .......

Component: web-platform-tests → Web Audio
Product: Testing → Core
Version: Version 3 → unspecified

This has failed 90 times in the last 7 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-04-09&endday=2019-04-16&tree=trunk&bug=1533762

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=240459521&repo=autoland

[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | > [buffer-stitching-1] Subsample buffer stitching, same rates
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-PASS | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | Test 1: context.sampleRate is equal to 44100.
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html | X Stitched sine-wave buffers at sample rate 44100 does not equal [0,0.06264832615852356,0.12505052983760834,0.18696144223213196,0.24813786149024963,0.308339387178421,0.36732956767082214,0.4248766303062439,0.4807544946670532,0.5347436666488647,0.5866319537162781,0.6362155675888062,0.683299720287323,0.7276993989944458,0.7692402005195618,0.8077588677406311...] with an element-wise tolerance of {"absoluteThreshold":0.000090957,"relativeThreshold":0}.
[task 2019-04-15T22:31:02.563Z] 22:31:02 INFO - Index Actual Expected AbsError RelError Test threshold
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2003] -9.6732087433338165e-2 -9.6823699772357941e-2 9.1612339019775391e-5 9.4617680624852212e-4 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2004] -3.4187544137239456e-2 -3.4279607236385345e-2 9.2063099145889282e-5 2.6856520995424621e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2005] 2.8491314500570297e-2 2.8398986905813217e-2 9.2327594757080078e-5 3.2510876202481997e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2006] 9.1058239340782166e-2 9.0966261923313141e-2 9.1977417469024658e-5 1.0111157205356415e-3 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [2007] 1.5326742827892303e-1 1.5317615866661072e-1 9.1269612312316895e-5 5.9584737668585898e-4 9.0957000000000003e-5
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - ...and 38030 more errors.
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - Max AbsError of 9.3160665051180724e-1 at index of 43680.
[task 2019-04-15T22:31:02.564Z] 22:31:02 INFO - [43680] 1.5932920260919303e-10 -9.3160665035247803e-1 9.3160665051180724e-1 1.0000000001710263e+0 9.0957000000000003e-5
[task 2019-04-15T22:31:02.566Z] 22:31:02 INFO - Max RelError of 5.5714977262789269e+1 at index of 30419.
[task 2019-04-15T22:31:02.566Z] 22:31:02 INFO - [30419] -1.4247581129893661e-3 -2.5121373255387880e-5 1.3996367397339782e-3 5.5714977262789269e+1 9.0957000000000003e-5
[task 2019-04-15T22:31:02.567Z] 22:31:02 INFO - - assert_true: expected true got false
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1587:25
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
[task 2019-04-15T22:31:02.568Z] 22:31:02 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
[task 2019-04-15T22:31:02.569Z] 22:31:02 INFO - beCloseToArray@http://web-platform.test:8000/webaudio/resources/audit.js:1009:19
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:41:24
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - promise callback*@http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:35:18
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1180:12
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - _runNextTask@http://web-platform.test:8000/webaudio/resources/audit.js:1239:67
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - run@http://web-platform.test:8000/webaudio/resources/audit.js:1309:12
[task 2019-04-15T22:31:02.570Z] 22:31:02 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-audiobuffersourcenode-interface/sub-sample-buffer-stitching.html:84:13

Nils, could you please redirect this to someone who can take a look?

Flags: needinfo?(drno)
Whiteboard: [stockwell disable-recommended] → [stockwell needswork:owner]
Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/43e4cb12a099
Disable sub-sample-buffer-stitching.html on windows 7 and linux for frequent failures. r=jmaher
Keywords: leave-open
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Regressed by: 1532838

Probably not my fault, probably.

Bug 1532838 changes when minor GCs will occur, it could be changing timing, if this test relies on sensative timing then that's why it may look like a cause.

Flags: needinfo?(pbone)

I meant to add, if WebAudio people look at this and want to ask me questions about GC / Bug 1532838 then I'd be happy to help.

Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e28c51cc8100
Disable sub-sample-buffer-stitching.html on all desktop platforms r=jmaher
Attachment #9063672 - Attachment is obsolete: true
Severity: normal → S4
Flags: needinfo?(drno)
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: