1604714 - ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/ | intermittence across several test files

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: egao [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281178123&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Tl17PicKQHSyJCVf302rag/runs/0/artifacts/public/logs/live_backing.log

---

suite: web-platform-tests
chunk: 8

notes: webrender

context:
[task 2019-12-14T11:31:41.552Z] 11:31:41 INFO - TEST-START | /screen-orientation/lock-unlock-check.html
[task 2019-12-14T11:31:41.564Z] 11:31:41 INFO - Closing window 35
[task 2019-12-14T11:31:42.473Z] 11:31:42 INFO - PID 22260 | JavaScript error: http://web-platform.test:8000/screen-orientation/lock-unlock-check.html, line 13: NotSupportedError: Operation is not supported
[task 2019-12-14T11:31:42.628Z] 11:31:42 INFO - TEST-UNEXPECTED-OK | /screen-orientation/lock-unlock-check.html | expected ERROR
[task 2019-12-14T11:31:42.629Z] 11:31:42 INFO - TEST-INFO expected ERROR | took 1075ms
[task 2019-12-14T11:31:42.649Z] 11:31:42 INFO - PID 22260 | 1576323102644 Marionette INFO Stopped listening on port 34511
[task 2019-12-14T11:31:43.397Z] 11:31:43 INFO - Browser exited with return code 0
[task 2019-12-14T11:31:43.398Z] 11:31:43 INFO - PROCESS LEAKS None
[task 2019-12-14T11:31:43.398Z] 11:31:43 INFO - PROCESS LEAKS None
[task 2019-12-14T11:31:43.401Z] 11:31:43 INFO - Closing logging queue
[task 2019-12-14T11:31:43.401Z] 11:31:43 INFO - queue closed
[task 2019-12-14T11:31:43.422Z] 11:31:43 INFO - Setting up ssl
[task 2019-12-14T11:31:43.446Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.473Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO - Certificate Nickname Trust Attributes
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO -

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR]

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

Changed title to reflect the several tests that mostly report OK, but intermittently fail with an ERROR outcome when run on ubuntu1804 with either webrender or asan.

This bug will handle annotating the affected tests under screen-orientation subsuite.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9ef604df43ae
mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher

Comment 4

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/9ef604df43ae

Comment 5

[Edwin Takahashi (:egao | infrequent contributor)]

Reopening bug as some more combination of build types needs to be inserted for ubuntu1804 and its expectations updated to reflect reality.

This work will be based off https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&tier=1%2C2%2C3&revision=7c42c7c9db6bf4d60eb457a287ee43207ce52780&selectedJob=283762635.

Comment 6

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1604714 - mark expected outcome of event-before-promise.html for linux1804-64-debug

Changes:

With agreement from the test owner, mark this test with the multiple expected outcome of ERROR, OK.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d937344edc75
mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher

Comment 8

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/d937344edc75