Closed Bug 1560454 Opened 5 years ago Closed 5 years ago

Intermittent /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | X ScriptProcessor output[1152:]: Expected 1 for all values but found 41599 unexpected values:

Categories

(Core :: Web Audio, defect, P5)

Product:
Core
Component:
Web Audio
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla69
Tracking Flags:
Tracking Status
firefox-esr60 --- unaffected
firefox-esr68 --- unaffected
firefox68 --- unaffected
firefox69 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: impossibus)

References

(Depends on 1 open bug, Regression)

Details

(Keywords: intermittent-failure, regression)

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=252710794&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/MEI02IfLTv-zd7wK0hNzQw/runs/0/artifacts/public/logs/live_backing.log

[task 2019-06-21T00:48:48.627Z] 00:48:48 INFO - TEST-START | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html
[task 2019-06-21T00:48:48.634Z] 00:48:48 INFO - Closing window 2147483665
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO -
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO - TEST-PASS | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | # AUDIT TASK RUNNER STARTED.
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO - TEST-PASS | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | > [test] ScriptProcessor with stopped input source
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO - TEST-PASS | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | ScriptProcessor output[0:1023] contains only the constant 0.
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO - TEST-FAIL | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | X ScriptProcessor output[1024:1151] does not equal [1,1.0575640201568604,1.11493718624115,1.171929121017456,1.2283508777618408,1.2840152978897095,1.3387378454208374,1.3923370838165283,1.4446351528167725,1.4954586029052734,1.5446388721466064,1.5920131206512451,1.6374238729476929,1.6807208061218262,1.7217600345611572,1.7604057788848877...] with an element-wise tolerance of {"absoluteThreshold":0,"relativeThreshold":0}.
[task 2019-06-21T00:48:48.956Z] 00:48:48 INFO - Index Actual Expected AbsError RelError Test threshold
[task 2019-06-21T00:48:48.957Z] 00:48:48 INFO - [0] 0.0000000000000000e+0 1.0000000000000000e+0 1.0000000000000000e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.957Z] 00:48:48 INFO - [1] 0.0000000000000000e+0 1.0575640201568604e+0 1.0575640201568604e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.957Z] 00:48:48 INFO - [2] 0.0000000000000000e+0 1.1149371862411499e+0 1.1149371862411499e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.957Z] 00:48:48 INFO - [3] 0.0000000000000000e+0 1.1719291210174561e+0 1.1719291210174561e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.958Z] 00:48:48 INFO - [4] 0.0000000000000000e+0 1.2283508777618408e+0 1.2283508777618408e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.958Z] 00:48:48 INFO - ...and 123 more errors.
[task 2019-06-21T00:48:48.958Z] 00:48:48 INFO - Max AbsError of 1.9998766183853149e+0 at index of 27.
[task 2019-06-21T00:48:48.958Z] 00:48:48 INFO - [27] 0.0000000000000000e+0 1.9998766183853149e+0 1.9998766183853149e+0 1.0000000000000000e+0 0.0000000000000000e+0
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - Max RelError of 1.0000000000000000e+0 at index of 0.
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - - assert_true: expected true got false
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1594:25
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - beCloseToArray@http://web-platform.test:8000/webaudio/resources/audit.js:1009:19
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html:83:24
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - TEST-UNEXPECTED-FAIL | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | X ScriptProcessor output[1152:]: Expected 1 for all values but found 46463 unexpected values:
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - Index Actual
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - [0] 0
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - [1] 0
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - [2] 0
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - [3] 0
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - ...and 46459 more errors. - assert_true: expected true got false
[task 2019-06-21T00:48:48.959Z] 00:48:48 INFO - _logFailed/<@http://web-platform.test:8000/webaudio/resources/audit.js:50:7
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1594:25
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - test@http://web-platform.test:8000/resources/testharness.js:544:30
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - _logFailed@http://web-platform.test:8000/webaudio/resources/audit.js:49:5
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - _finalize@http://web-platform.test:8000/webaudio/resources/audit.js:215:9
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - _assert@http://web-platform.test:8000/webaudio/resources/audit.js:228:12
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - beConstantValueOf@http://web-platform.test:8000/webaudio/resources/audit.js:662:19
[task 2019-06-21T00:48:48.960Z] 00:48:48 INFO - @http://web-platform.test:8000/webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html:90:24
[task 2019-06-21T00:48:49.183Z] 00:48:49 INFO - ..
[task 2019-06-21T00:48:49.183Z] 00:48:49 INFO - TEST-OK | /webaudio/the-audio-api/the-scriptprocessornode-interface/simple-input-output.html | took 557ms
[task 2019-06-21T00:48:49.962Z] 00:48:49 INFO - Closing logging queue
[task 2019-06-21T00:48:49.962Z] 00:48:49 INFO - queue closed
[task 2019-06-21T00:48:49.986Z] 00:48:49 INFO - Setting up ssl
[task 2019-06-21T00:48:50.028Z] 00:48:50 INFO - certutil |
[task 2019-06-21T00:48:50.081Z] 00:48:50 INFO - certutil |
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO - certutil |
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO - Certificate Nickname Trust Attributes
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO - SSL,S/MIME,JAR/XPI
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO -
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO - web-platform-tests CT,,
[task 2019-06-21T00:48:50.109Z] 00:48:50 INFO -
[task 2019-06-21T00:48:51.965Z] 00:48:51 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-06-21T00:48:53.629Z] 00:48:53 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_PROCESS_LOG=/tmp/tmpQ7znUKpidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --ez use_multiprocess True --es env10 R_LOG_LEVEL=6
[task 2019-06-21T00:48:55.607Z] 00:48:55 INFO - Starting runner

Flags: needinfo?(james) → needinfo?(mjzffr)

padenot, can you see why this new WebAudio test might be failing intermittently on Android? Or redirect to someone else who can help? Thanks.

Flags: needinfo?(mjzffr) → needinfo?(padenot)

This is a new test. It is making assumptions about latency that are not specified. I'm surprised it is passing on any platform. The test should be disabled.

Related: bug 1560152.

Depends on: 1560152
Flags: needinfo?(padenot)
Pushed by mjzffr@gmail.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/e535fc397ba1
Disable flaky WebAudio test; a=testonly

https://hg.mozilla.org/mozilla-central/rev/e535fc397ba1

Status: NEW → RESOLVED
Closed: 5 years ago
status-firefox69: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla69
Assignee: nobody → mjzffr
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.