1355255 - Intermittent test_navigation.py TestRefresh.test_image | TimeoutException: Timed out after 9.0 seconds with message: No new tab has been opened

Status: VERIFIED INCOMPLETE

(Testing :: Marionette Client and Harness, defect)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=90249233&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/VC6aji33Rkm1k_-8GacrgQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: screenshot.png

[task 2017-04-10T21:49:43.563342Z] 21:49:43     INFO - TEST-UNEXPECTED-ERROR | test_navigation.py TestRefresh.test_image | TimeoutException: Timed out after 9.0 seconds with message: No new tab has been opened
[task 2017-04-10T21:49:43.563722Z] 21:49:43     INFO - Traceback (most recent call last):
[task 2017-04-10T21:49:43.563861Z] 21:49:43     INFO -   File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 147, in run
[task 2017-04-10T21:49:43.563981Z] 21:49:43     INFO -     self.setUp()
[task 2017-04-10T21:49:43.564114Z] 21:49:43     INFO -   File "/home/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_navigation.py", line 45, in setUp
[task 2017-04-10T21:49:43.564203Z] 21:49:43     INFO -     self.new_tab = self.open_tab(open_with_link)
[task 2017-04-10T21:49:43.564342Z] 21:49:43     INFO -   File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/marionette_harness/runner/mixins/window_manager.py", line 88, in open_tab
[task 2017-04-10T21:49:43.564846Z] 21:49:43     INFO -     message="No new tab has been opened"
[task 2017-04-10T21:49:43.565398Z] 21:49:43     INFO -   File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/marionette_driver/wait.py", line 150, in until
[task 2017-04-10T21:49:43.565976Z] 21:49:43     INFO -     cause=last_exc)

From the trace log I see:

1491860973067	Marionette	TRACE	1008 -> [0,13,"findElement",{"using":"id","value":"new-blank-tab"}]
1491860973081	Marionette	TRACE	1008 <- [1,13,null,{"value":{"element-6066-11e4-a52e-4f735466cecf":"405fb195-f5da-4af6-873f-22aeed93ce39","ELEMENT":"405fb195-f5da-4af6-873f-22aeed93ce39"}}]
1491860973084	Marionette	TRACE	1008 -> [0,14,"clickElement",{"id":"405fb195-f5da-4af6-873f-22aeed93ce39"}]
1491860973282	Marionette	TRACE	1008 <- [1,14,null,{}]
1491860973292	Marionette	TRACE	1008 -> [0,15,"getWindowHandles",{}]
1491860973296	Marionette	TRACE	1008 <- [1,15,null,["2147484123"]]
[..]
1491860976096	Marionette	TRACE	1008 -> [0,43,"getWindowHandles",{}]
1491860976100	Marionette	TRACE	1008 <- [1,43,null,["2147484123"]]

So we successfully loaded the test page, retrieved the link, and clicked on it. But then `getWindowHandles()` never reports that a secondary tab has been opened.

Checking report.html shows an interesting fact:
https://public-artifacts.taskcluster.net/VC6aji33Rkm1k_-8GacrgQ/0/public/test_info//report.html

As you can see in this attachment the tab is indeed open! So why do we still get only window handle returned? Is there a problem with the window enumerator?

Comment 2

[Intermittent Failures Robot]

2 failures in 656 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* linux32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1355255&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1355255&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 4

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.