Open Bug 1591638 Opened 9 months ago Updated 15 days ago

Intermittent /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html | HTMLTrackElement 'src' attribute mutations - assert_unreached: 'error' event did not fire, stage = 4 Reached unreachable code

Categories

(Core :: DOM: Core & HTML, defect, P3)

defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, leave-open, Whiteboard: [retriggered][stockwell disabled])

Attachments

(1 file)

Filed by: aciure [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=273044694&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/J_mQOjteSPO1-L1TJEo5Ag/runs/0/artifacts/public/logs/live_backing.log


[task 2019-10-26T00:04:46.915Z] 00:04:46 INFO - TEST-START | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html
[task 2019-10-26T00:04:46.915Z] 00:04:46 INFO - Closing window 82
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO -
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - TEST-UNEXPECTED-FAIL | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html | HTMLTrackElement 'src' attribute mutations - assert_unreached: 'error' event did not fire, stage = 4 Reached unreachable code
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - step_onLoad@http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:25:37
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1908:25
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:1932:35
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - EventHandlerNonNull*@http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:82:30
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1908:25
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - async_test@http://web-platform.test:8000/resources/testharness.js:576:22
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - @http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:8:15
[task 2019-10-26T00:04:47.490Z] 00:04:47 INFO - TEST-OK | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html | took 547ms
[task 2019-10-26T00:04:47.491Z] 00:04:47 INFO - PID 2278 | 1572048287464 Marionette INFO Stopped listening on port 50110
[task 2019-10-26T00:04:48.283Z] 00:04:48 INFO - Browser exited with return code 0
[task 2019-10-26T00:04:48.283Z] 00:04:48 INFO - PROCESS LEAKS None
[task 2019-10-26T00:04:48.283Z] 00:04:48 INFO - Closing logging queue
[task 2019-10-26T00:04:48.283Z] 00:04:48 INFO - queue closed
[task 2019-10-26T00:04:48.303Z] 00:04:48 INFO - Setting up ssl
[task 2019-10-26T00:04:48.353Z] 00:04:48 INFO - certutil |
[task 2019-10-26T00:04:48.379Z] 00:04:48 INFO - certutil |
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO - certutil |
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO - Certificate Nickname Trust Attributes
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO - SSL,S/MIME,JAR/XPI
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO -
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO - web-platform-tests CT,,
[task 2019-10-26T00:04:48.412Z] 00:04:48 INFO -
[task 2019-10-26T00:04:48.439Z] 00:04:48 INFO - Application command: /Users/cltbld/tasks/task_1572047630/build/application/Firefox Nightly.app/Contents/MacOS/firefox --marionette about:blank -foreground -profile /var/folders/zw/128m5fxs26bcf56v5_bgpjzh000017/T/tmp6pEPhB.mozrunner
[task 2019-10-26T00:04:48.449Z] 00:04:48 INFO - Starting runner
[task 2019-10-26T00:04:49.253Z] 00:04:49 INFO - PID 2320 | 1572048289223 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: mozillaAddons
[task 2019-10-26T00:04:49.253Z] 00:04:49 INFO - PID 2320 | 1572048289223 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: telemetry
[task 2019-10-26T00:04:49.253Z] 00:04:49 INFO - PID 2320 | 1572048289224 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: resource://pdf.js/
[task 2019-10-26T00:04:49.253Z] 00:04:49 INFO - PID 2320 | 1572048289224 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid extension permission: about:reader*
[task 2019-10-26T00:04:51.877Z] 00:04:51 INFO - PID 2320 | 1572048291860 Marionette INFO Listening on port 50110

Retrigger results point to bug 1591227.

Mike please take a look.

Flags: needinfo?(mconley)
Regressed by: 1591227
Whiteboard: [retriggered]

Hi Geoff, do we backout here or disable the test?

There are 96 total failures since October 25th.

Flags: needinfo?(gbrown)

(In reply to Andreea Pavel [:apavel] from comment #5)

Hi Geoff, do we backout here or disable the test?
If in doubt, it's best to check with the patch author.

Flags: needinfo?(gbrown)
Pushed by ncsoregi@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/84c97e387e08
Add expectation for track-element-src-change-error.html that is frequently failing on mac. r=jgraham

Backed out changeset 84c97e387e08 (bug 1591638) for failing at track-element-src-change-error.html on a CLOSED TREE.

Backout link: https://hg.mozilla.org/integration/autoland/rev/475496111203207e076e6ac8c62d4dfc87df871f

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=os%2Cx%2C10.14%2Cshippable%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-macosx1014-64-shippable%2Fopt-web-platform-tests-e10s-9%2Cw%28wpt9%29&revision=84c97e387e081fbeb2640b838810234178a13549&selectedJob=274048940

Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=274048940&repo=autoland&lineNumber=3293

Log snippet:
[task 2019-11-01T10:15:17.586Z] 10:15:17 INFO - TEST-START | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html
[task 2019-11-01T10:15:17.589Z] 10:15:17 INFO - Closing window 82
[task 2019-11-01T10:15:18.318Z] 10:15:18 INFO -
[task 2019-11-01T10:15:18.318Z] 10:15:18 INFO - TEST-UNEXPECTED-FAIL | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html | HTMLTrackElement 'src' attribute mutations - assert_unreached: 'error' event did not fire, stage = 4 Reached unreachable code
[task 2019-11-01T10:15:18.318Z] 10:15:18 INFO - step_onLoad@http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:25:37
[task 2019-11-01T10:15:18.318Z] 10:15:18 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1908:25
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:1932:35
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - EventHandlerNonNull*@http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:82:30
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1908:25
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - async_test@http://web-platform.test:8000/resources/testharness.js:576:22
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - @http://web-platform.test:8000/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html:8:15
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - TEST-UNEXPECTED-OK | /html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html | expected PASS
[task 2019-11-01T10:15:18.319Z] 10:15:18 INFO - TEST-INFO took 744ms
[task 2019-11-01T10:15:18.322Z] 10:15:18 INFO - PID 2284 | 1572603318308 Marionette INFO Stopped listening on port 50208
[task 2019-11-01T10:15:19.015Z] 10:15:19 INFO - Browser exited with return code 0
[task 2019-11-01T10:15:19.015Z] 10:15:19 INFO - PROCESS LEAKS None
[task 2019-11-01T10:15:19.020Z] 10:15:19 INFO - Closing logging queue
[task 2019-11-01T10:15:19.020Z] 10:15:19 INFO - queue closed
[task 2019-11-01T10:15:19.040Z] 10:15:19 INFO - Setting up ssl
[task 2019-11-01T10:15:19.120Z] 10:15:19 INFO - certutil |
[task 2019-11-01T10:15:19.161Z] 10:15:19 INFO - certutil |
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO - certutil |
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO - Certificate Nickname Trust Attributes
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO - SSL,S/MIME,JAR/XPI
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO -
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO - web-platform-tests CT,,
[task 2019-11-01T10:15:19.170Z] 10:15:19 INFO -

Flags: needinfo?(csabou)

I'd love to diagnose this rather than try to wallpaper over it - is there a way I can capture the contents of the error that fired?

Flags: needinfo?(mconley) → needinfo?(james)

I'll abandon my patch then in the hope of getting this fixed and not swept under the wpt metada update.

Flags: needinfo?(csabou)
Attachment #9105507 - Attachment is obsolete: true

(In reply to Mike Conley (:mconley) (:⚙️) (Wayyyy behind on needinfos) from comment #12)

I'd love to diagnose this rather than try to wallpaper over it - is there a way I can capture the contents of the error that fired?

Mike since this reached the disabling queue, should we disable it until you have a fix?

Flags: needinfo?(mconley)

I'd love to diagnose this rather than try to wallpaper over it - is there a way I can capture the contents of the error that fired?

AFAICT from the log the problem is that an error didn't fire. It could be that the test is assuming the error will fire in some sepcific time interval and we aren't consistently hitting that limit? Indeed [1] looks suspiciously like a 100ms timeout, which is very short.

[1] https://searchfox.org/mozilla-central/source/testing/web-platform/tests/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html#35,67

Flags: needinfo?(james)

(In reply to James Graham [:jgraham] from comment #17)

AFAICT from the log the problem is that an error didn't fire. It could be that the test is assuming the error will fire in some sepcific time interval and we aren't consistently hitting that limit? Indeed [1] looks suspiciously like a 100ms timeout, which is very short.

[1] https://searchfox.org/mozilla-central/source/testing/web-platform/tests/html/semantics/embedded-content/media-elements/track/track-element/track-element-src-change-error.html#35,67

Hm, good catch, yeah - this looks like we expect an error, and we give 100ms for it to show up? Any thoughts on what we should do about this?

Flags: needinfo?(mconley) → needinfo?(james)
Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered]

Geoff do we disable until a fix is ready or wait for the fix?

Flags: needinfo?(gbrown)

In light of comment 12 and the recent discussion here, let's leave it up to mconley.

:mconley - Be aware that this is failing very frequently and is well above the disable-recommended threshold. Failures are all on osx; we would only disable on osx.

Flags: needinfo?(gbrown) → needinfo?(mconley)

I'm not the right person to make this call, since at least according to comment 17, this might be a case of a test being too sensitive to underlying timing issues. I think we should wait for jgraham to respond here.

Flags: needinfo?(mconley)
Attachment #9105507 - Attachment is obsolete: false
Attachment #9105507 - Attachment description: Bug 1591638 - Add expectation for track-element-src-change-error.html that is frequently failing on mac. r=jgraham → Bug 1591638 - Disable track-element-src-change-error.html that is frequently failing on mac. r=jgraham

Updated the patch in case we want to disable the test on mac.

Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/156ff05f662e
Disable track-element-src-change-error.html that is frequently failing on mac. r=jgraham
Keywords: leave-open
Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered][stockwell disabled]
Priority: -- → P3

I (finally) did a try push of this with the timeout increased to 1s, and it was still intermittent, so I think there's something more subtle going on.

Flags: needinfo?(james)
You need to log in before you can comment on or make changes to this bug.