Closed Bug 1393051 Opened 7 years ago Closed 6 years ago

Intermittent TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/state/get_element_attribute.py | expected OK

Categories

(Remote Protocol :: Marionette, defect, P5)

Product:
Remote Protocol
Component:
Marionette
Version:
Version 3
Type:
defect

Tracking

(firefox-esr52 unaffected, firefox56 unaffected, firefox57 wontfix, firefox58 fixed, firefox59 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla59
Tracking Flags:
Tracking Status
firefox-esr52 --- unaffected
firefox56 --- unaffected
firefox57 --- wontfix
firefox58 --- fixed
firefox59 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: whimboo)

References

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell unknown]) 

I'm fairly sure this is another regression from bug 1392346. A fix for bug 1392854 should also fix this bug.
Blocks: 1392346
status-firefox56: --- → unaffected
status-firefox57: --- → affected
Depends on: 1392854
Keywords: regression
Priority: P5 → P3
(In reply to Henrik Skupin (:whimboo) from comment #2)
> I'm fairly sure this is another regression from bug 1392346. A fix for bug
> 1392854 should also fix this bug.

Andreas, do you think that this failure has also been fixed now?
Flags: needinfo?(ato)
(In reply to Henrik Skupin (:whimboo) from comment #4)

> (In reply to Henrik Skupin (:whimboo) from comment #2)
> 
> > I'm fairly sure this is another regression from bug 1392346. A
> > fix for bug 1392854 should also fix this bug.

To me a timeout isn’t consistent with the fallout we saw from
https://bugzilla.mozilla.org/show_bug.cgi?id=1392346, which was to
do with staleness checks on XUL elements.  There are no XUL elements
in use for the Get Element Attribute as far as I know.
Flags: needinfo?(ato)
Whiteboard: [stockwell needswork]
The failing test in question here is:

https://dxr.mozilla.org/mozilla-central/rev/04b6be50a2526c7a26a63715f441c47e1aa1f9be/testing/web-platform/tests/webdriver/tests/state/get_element_attribute.py#160

And that specifically for the parameters `button` and `autofocus`:

[task 2017-09-01T00:36:14.250563Z] 00:36:14     INFO - STDOUT: testing boolean attribute <button autofocus>
[task 2017-09-01T00:36:14.266554Z] 00:36:14     INFO - PID 2704 | 1504226174255	Marionette	DEBUG	Received DOM event "beforeunload" for "data:text/html;charset=utf-8,%3Caudio%20muted%3E"
[task 2017-09-01T00:36:14.268527Z] 00:36:14     INFO - PID 2704 | 1504226174264	Marionette	DEBUG	Received DOM event "pagehide" for "data:text/html;charset=utf-8,%3Caudio%20muted%3E"
[task 2017-09-01T00:36:14.270237Z] 00:36:14     INFO - PID 2704 | 1504226174265	Marionette	DEBUG	Received DOM event "unload" for "data:text/html;charset=utf-8,%3Caudio%20muted%3E"
[task 2017-09-01T00:36:14.270829Z] 00:36:14     INFO - PID 2704 | ++DOMWINDOW == 11 (0x23364c0) [pid = 3073] [serial = 12] [outer = 0x1917240]
[task 2017-09-01T00:36:14.307394Z] 00:36:14     INFO - PID 2704 | 1504226174300	Marionette	DEBUG	Received DOM event "DOMContentLoaded" for "data:text/html;charset=utf-8,%3Cbutton%20autofocus%3E"
[task 2017-09-01T00:36:14.315459Z] 00:36:14     INFO - PID 2704 | 1504226174309	Marionette	DEBUG	Received DOM event "pageshow" for "data:text/html;charset=utf-8,%3Cbutton%20autofocus%3E"
[task 2017-09-01T00:36:14.800589Z] 00:36:14     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/state/get_element_attribute.py | expected OK

This is a new test which landed 10 days ago by David via bug 1376625. David, can you please have a look at this?
Flags: needinfo?(dburns)
Left this running for 1h30 to try reproduce and couldn't. yay for consistent environments!
Managed to recreate it!

It looks like the the new photon "Nightly - Tip: Get Help by looking...." seems. I dont have proof by when that appears the test times out, when it doesnt then it works.
Flags: needinfo?(dburns)
(In reply to David Burns :automatedtester from comment #10)
> It looks like the the new photon "Nightly - Tip: Get Help by looking...."
> seems. I dont have proof by when that appears the test times out, when it
> doesnt then it works.

I think we should disable this popup by default in both Marionette and geckodriver.
Bulk priority update of open intermittent test failure bugs. 

P3 => P5

https://bugzilla.mozilla.org/show_bug.cgi?id=1381960
Priority: P3 → P5
The increase of failures yesterday is due to the landing of my patch on bug 1403923. A follow-up should hopefully land soon, which then will also fix this bug.

Why do we fail here? It's because the test exceeds the 25s default timeout for opt builds, and takes even way longer for debug builds. Via bug 1403923 the test requests a long timeout now.

[task 2017-12-19T23:52:14.669Z] 23:52:14     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/state/get_element_attribute.py | expected OK
[task 2017-12-19T23:52:14.669Z] 23:52:14     INFO - TEST-INFO took 30013ms

[task 2017-12-19T18:31:14.574Z] 18:31:14     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/state/get_element_attribute.py | expected OK
[task 2017-12-19T18:31:14.574Z] 18:31:14     INFO - TEST-INFO took 80010ms
Depends on: 1403923
This failure is gone now with the increased timeout via bug 1403923.
Assignee: nobody → hskupin
Status: NEW → RESOLVED
Closed: 6 years ago
status-firefox59: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla59
Depends on: 1431058
No longer depends on: 1431058
Moving bug to Remote Protocol::Marionette component per bug 1815831.
Component: geckodriver → Marionette
Product: Testing → Remote Protocol
You need to log in before you can comment on or make changes to this bug.