Closed Bug 1604714 Opened 3 years ago Closed 3 years ago

ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/ | intermittence across several test files

Categories

(Core :: DOM: Core & HTML, defect, P5)

defect

Tracking

()

RESOLVED FIXED
mozilla73
Tracking Status
firefox73 --- fixed
firefox74 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: egao)

References

(Blocks 1 open bug)

Details

(Keywords: intermittent-failure)

Attachments

(1 file, 1 obsolete file)

Filed by: egao [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281178123&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Tl17PicKQHSyJCVf302rag/runs/0/artifacts/public/logs/live_backing.log


suite: web-platform-tests
chunk: 8

notes: webrender

context:
[task 2019-12-14T11:31:41.552Z] 11:31:41 INFO - TEST-START | /screen-orientation/lock-unlock-check.html
[task 2019-12-14T11:31:41.564Z] 11:31:41 INFO - Closing window 35
[task 2019-12-14T11:31:42.473Z] 11:31:42 INFO - PID 22260 | JavaScript error: http://web-platform.test:8000/screen-orientation/lock-unlock-check.html, line 13: NotSupportedError: Operation is not supported
[task 2019-12-14T11:31:42.628Z] 11:31:42 INFO - TEST-UNEXPECTED-OK | /screen-orientation/lock-unlock-check.html | expected ERROR
[task 2019-12-14T11:31:42.629Z] 11:31:42 INFO - TEST-INFO expected ERROR | took 1075ms
[task 2019-12-14T11:31:42.649Z] 11:31:42 INFO - PID 22260 | 1576323102644 Marionette INFO Stopped listening on port 34511
[task 2019-12-14T11:31:43.397Z] 11:31:43 INFO - Browser exited with return code 0
[task 2019-12-14T11:31:43.398Z] 11:31:43 INFO - PROCESS LEAKS None
[task 2019-12-14T11:31:43.398Z] 11:31:43 INFO - PROCESS LEAKS None
[task 2019-12-14T11:31:43.401Z] 11:31:43 INFO - Closing logging queue
[task 2019-12-14T11:31:43.401Z] 11:31:43 INFO - queue closed
[task 2019-12-14T11:31:43.422Z] 11:31:43 INFO - Setting up ssl
[task 2019-12-14T11:31:43.446Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.473Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO - certutil |
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO - Certificate Nickname Trust Attributes
[task 2019-12-14T11:31:43.494Z] 11:31:43 INFO -

Summary: ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/lock-unlock-check.html | expected ERROR → ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/ | expected ERROR | multiple test file intermittence

Changed title to reflect the several tests that mostly report OK, but intermittently fail with an ERROR outcome when run on ubuntu1804 with either webrender or asan.

This bug will handle annotating the affected tests under screen-orientation subsuite.

Attachment #9116758 - Attachment description: Bug 1604714 - mark lock-unlock-check.html on ubuntu1804 webrender with expectation of [OK, ERROR] due to flakiness → Bug 1604714 - mark screen-orientation tests on ubuntu1804 webrender with expectation of [OK, ERROR] due to flakiness
Attachment #9116758 - Attachment description: Bug 1604714 - mark screen-orientation tests on ubuntu1804 webrender with expectation of [OK, ERROR] due to flakiness → Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender with expectation of [OK, ERROR]
Attachment #9116758 - Attachment description: Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender with expectation of [OK, ERROR] → Bug 1604714 - mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR]
Assignee: nobody → egao
Status: NEW → ASSIGNED
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/9ef604df43ae
mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla73
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Summary: ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/ | expected ERROR | multiple test file intermittence → ubuntu1804 - TEST-UNEXPECTED-OK | /screen-orientation/ | intermittence across several test files

Reopening bug as some more combination of build types needs to be inserted for ubuntu1804 and its expectations updated to reflect reality.

This work will be based off https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&tier=1%2C2%2C3&revision=7c42c7c9db6bf4d60eb457a287ee43207ce52780&selectedJob=283762635.

Changes:

With agreement from the test owner, mark this test with the multiple expected outcome of ERROR, OK.

Attachment #9119865 - Attachment is obsolete: true
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d937344edc75
mark flaky screen-orientation tests on ubuntu1804 webrender/asan with expectation of [OK, ERROR] r=jmaher
Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.