1524813 - Intermittent ccov windows TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/permissions/set.py | expected OK

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: rmaries [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=225687736&repo=mozilla-central

https://queue.taskcluster.net/v1/task/ZiCeaMoNQi6B4jzhK838lQ/runs/0/artifacts/public/logs/live_backing.log

23:37:10 INFO - TEST-START | /webdriver/tests/permissions/set.py
23:37:10 INFO - STDOUT: ============================= test session starts =============================
23:37:10 INFO - STDOUT: platform win32 -- Python 2.7.15, pytest-unknown, py-1.5.2, pluggy-0.5.3.dev -- Z:\task_1549148765\build\venv\Scripts\python.exe
23:37:10 INFO - STDOUT: rootdir: Z:\task_1549148765\build, inifile:
23:37:10 INFO - STDOUT: collecting ...
23:37:10 INFO - STDOUT: collected 26 items
23:37:10 INFO - STDOUT: tests/web-platform/tests/webdriver/tests/permissions/set.py::test_invalid_parameters[parameters0]

23:37:40 INFO - STDOUT: :50: AssertionError
23:37:40 INFO - STDOUT: ___________________ test_set_to_state[realmSetting0-denied] ___________________
23:37:40 INFO - STDOUT: session = <Session fcae45db-ea0b-4989-9d8f-bc179534faf6>, state = 'denied'
23:37:40 INFO - STDOUT: realmSetting = {'oneRealm': True}
23:37:40 INFO - STDOUT: @pytest.mark.parametrize("state", ["granted", "denied", "prompt"])
23:37:40 INFO - STDOUT: @pytest.mark.parametrize("realmSetting", [
23:37:40 INFO - STDOUT: { "oneRealm": True },
23:37:40 INFO - STDOUT: { "oneRealm": False },
23:37:40 INFO - STDOUT: {}
23:37:40 INFO - STDOUT: ])
23:37:40 INFO - STDOUT: def test_set_to_state(session, state, realmSetting):
23:37:40 INFO - STDOUT: parameters = { "descriptor": { "name": "geolocation" }, "state": state }
23:37:40 INFO - STDOUT: parameters.update(realmSetting)
23:37:40 INFO - STDOUT: response = session.transport.send(
23:37:40 INFO - STDOUT: "POST", "/session/{session_id}/permissions".format(**vars(session)),
23:37:40 INFO - STDOUT: parameters
23:37:40 INFO - STDOUT: )
23:37:40 INFO - STDOUT:
23:37:40 INFO - STDOUT: try:
23:37:40 INFO - STDOUT: assert_success(response)
23:37:40 INFO - STDOUT: except AssertionError:
23:37:40 INFO - STDOUT: # > 4. If parameters.state is an inappropriate permission state for any
23:37:40 INFO - STDOUT: # > implementation-defined reason, return a WebDriver error with
23:37:40 INFO - STDOUT: # > WebDriver error code invalid argument.
23:37:40 INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/permissions/set.py | expected OK
23:37:40 INFO - TEST-INFO took 30008ms
23:37:50 WARNING - Forcibly terminating runner process
23:37:50 INFO - Starting runner
23:37:51 INFO - PID 9100 | 1549150671087 webdriver::httpapi DEBUG Creating routes
23:37:51 INFO - PID 9100 | 1549150671098 geckodriver DEBUG Listening on 127.0.0.1:4444
23:37:51 INFO - WebDriver HTTP server listening at http://127.0.0.1:4444/

Comment 1

[Intermittent Failures Robot]

1 failures in 2628 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Something broken with this quantum render build. Might be similar to bug 1524776.

Comment 3

[Intermittent Failures Robot]

1 failures in 2658 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Reopening, because even with the patch on bug 1524813 this is still perma failing due to bug 1382162.

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Here a try build that shows the problem:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=287601422&repo=try

As it looks like shutting down Firefox takes a really long time, which is around 11s for each of the tests.

Comment 7

[Andreea Pavel [:apavel]]

(In reply to Henrik Skupin (:whimboo) [⌚️UTC+1] from comment #5)

Reopening, because even with the patch on bug 1524813 this is still perma failing due to bug 1382162.

Did you mean a different bug here?

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Actually yes, I meant bug 1495002 where you put your patches on. Given that this test still fails your patch needs to update the referenced bug id to that one.

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Marking it again as duplicate given that we only enable a small portion of disabled tests on bug 1495002.

Comment 10

[Andreea Pavel [:apavel]]

Attachment: Bug 1524813 - update bug reference in disable comment r=whimboo

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+1]]

There was a mix-up for patches on bug 1495002. After clarifying with Andreea, we decided to reopen this bug for the remaining perma failing test.

Comment 12

[Intermittent Failures Robot]

1 failures in 4690 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 5233 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 14

[Intermittent Failures Robot]

9 failures in 5483 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• autoland: 4
• try: 4

Platform breakdown:

• linux64-qr: 1
• macosx1014-64-shippable: 6
• macosx1014-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 15

[Intermittent Failures Robot]

10 failures in 5336 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 1
• mozilla-central: 2
• try: 1

Platform breakdown:

• macosx1014-64-shippable: 9
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 16

[Intermittent Failures Robot]

9 failures in 4955 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 5
• try: 4

Platform breakdown:

• windows10-64: 1
• macosx1014-64-devedition: 2
• windows7-32-shippable: 1
• windows10-64-shippable: 2
• windows7-32-devedition: 1
• windows10-64-shippable-qr: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 17

[Intermittent Failures Robot]

5 failures in 4773 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 4
• try: 1

Platform breakdown:

• macosx1014-64-shippable: 2
• linux64: 1
• windows10-64-shippable: 1
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 18

[Intermittent Failures Robot]

5 failures in 5015 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-release: 2
• mozilla-beta: 2

Platform breakdown:

• macosx1014-64-shippable: 4
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1524813&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 19

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This test was actually marked as disabled for CCOV on Windows via bug 1495002 (see comment 11) and as such the bug shouldn't have been closed. I'll get the test re-enabled along with my changes for bug 1741802.

Comment 21

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Fixed by bug 1741802.

Comment 22

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.