1149843 - Intermittent test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out | ValueError: list.remove(x): x not in list

Status: RESOLVED WORKSFORME

(Testing :: Marionette Client and Harness, defect)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

15:22:51 INFO - TEST-PASS | test_window_management.py TestSwitchWindow.testShouldLoadAWindowAndThenCloseIt | took 2275ms
15:22:51 INFO - TEST-START | test_window_management.py TestSwitchWindow.test_windows
15:22:52 INFO - TEST-PASS | test_window_management.py TestSwitchWindow.test_windows | took 1248ms
15:22:52 INFO - TEST-START | test_window_position.py TestWindowPosition.test_that_we_can_get_an_error_when_passing_something_other_than_integers
15:22:53 INFO - TEST-PASS | test_window_position.py TestWindowPosition.test_that_we_can_get_an_error_when_passing_something_other_than_integers | took 453ms
15:22:53 INFO - TEST-START | test_window_position.py TestWindowPosition.test_that_we_can_set_the_window_position
15:22:53 INFO - TEST-PASS | test_window_position.py TestWindowPosition.test_that_we_can_set_the_window_position | took 472ms
15:22:53 INFO - TEST-START | test_window_position.py TestWindowPosition.test_that_we_return_the_window_position
15:22:54 INFO - TEST-PASS | test_window_position.py TestWindowPosition.test_that_we_return_the_window_position | took 456ms
15:22:54 INFO - TEST-START | test_window_handles.py TestWindowHandles.test_chrome_windows
15:22:59 INFO - TEST-PASS | test_window_handles.py TestWindowHandles.test_chrome_windows | took 5492ms
15:22:59 INFO - TEST-START | test_window_handles.py TestWindowHandles.test_link_opened_tab_window_handles
15:23:01 INFO - TEST-PASS | test_window_handles.py TestWindowHandles.test_link_opened_tab_window_handles | took 1692ms
15:23:01 INFO - TEST-START | test_window_handles.py TestWindowHandles.test_new_tab_window_handles
15:23:34 ERROR - TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
15:23:34 INFO - Traceback (most recent call last):
15:23:34 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 296, in run
15:23:34 INFO - testMethod()
15:23:34 INFO - File "/builds/slave/test/build/tests/marionette/tests/testing/marionette/client/marionette/tests/unit/test_window_handles.py", line 30, in test_new_tab_window_handles
15:23:34 INFO - self.wait_for_condition(lambda mn: len(mn.window_handles) == 2)
15:23:34 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 677, in wait_for_condition
15:23:34 INFO - raise TimeoutException("wait_for_condition timed out")
15:23:34 INFO - TEST-INFO took 32904ms
15:23:34 INFO - TEST-START | test_window_handles.py TestWindowHandles.test_tab_and_window_handles
15:23:37 ERROR - TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
15:23:37 INFO - Traceback (most recent call last):
15:23:37 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 296, in run
15:23:37 INFO - testMethod()
15:23:37 INFO - File "/builds/slave/test/build/tests/marionette/tests/testing/marionette/client/marionette/tests/unit/test_window_handles.py", line 113, in test_tab_and_window_handles
15:23:37 INFO - handles.remove(start_tab)
15:23:37 INFO - TEST-INFO took 3687ms
15:23:37 INFO - TEST-START | test_appcache.py AppCacheTests.testWeCanGetTheStatusOfTheAppCache
15:23:38 INFO - TEST-PASS | test_appcache.py AppCacheTests.testWeCanGetTheStatusOfTheAppCache | took 963ms
15:23:38 INFO - TEST-START | test_screenshot.py ScreenshotTests.testNotAllowedScreenshotFormatRaiseValueError
15:23:40 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testNotAllowedScreenshotFormatRaiseValueError | took 1076ms
15:23:40 INFO - TEST-START | test_screenshot.py ScreenshotTests.testWeCanTakeABinaryScreenShotOfAnElement
15:23:40 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testWeCanTakeABinaryScreenShotOfAnElement | took 877ms
15:23:40 INFO - TEST-START | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfAnElement
15:23:41 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfAnElement | took 854ms
15:23:41 INFO - TEST-START | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfEntireCanvas
15:23:42 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfEntireCanvas | took 1008ms
15:23:42 INFO - TEST-START | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfEntireViewport
15:23:44 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotOfEntireViewport | took 1654ms
15:23:44 INFO - TEST-START | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotWithHighlightOfAnElement
15:23:45 INFO - TEST-PASS | test_screenshot.py ScreenshotTests.testWeCanTakeAScreenShotWithHighlightOfAnElement | took 849ms
15:23:45 INFO - TEST-START | test_cookies.py CookieTest.testAddCookie
15:23:46 INFO - TEST-PASS | test_cookies.py CookieTest.testAddCookie | took 940ms
15:23:46 INFO - TEST-START | test_cookies.py CookieTest.testAddingACookieThatExpiredInThePast
15:23:47 INFO - TEST-PASS | test_cookies.py CookieTest.testAddingACookieThatExpiredInThePast | took 803ms
15:23:47 INFO - TEST-START | test_cookies.py CookieTest.testDeleteAllCookie

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2498958
repository: fx-team
start_time: 2015-03-31T15:15:47
who: wkocher[at]mozilla[dot]com
machine: tst-linux32-spot-140
buildname: Ubuntu VM 12.04 fx-team opt test marionette-e10s
revision: 8dd6520e5a55

TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
Return code: 10

Comment 2

[Chris Manchester (limited bugmail, email directly)]

Dang, this test rather obviously hits network. I'm sure I can figure out how not to do that.

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=8360517
repository: mozilla-inbound
start_time: 2015-04-01T09:42:16
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux32-spot-206
buildname: Ubuntu VM 12.04 mozilla-inbound opt test marionette-e10s
revision: 4a1a45bc093a

TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
Return code: 10

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2513063
repository: fx-team
start_time: 2015-04-01T10:57:58
who: wkocher[at]mozilla[dot]com
machine: tst-linux32-spot-089
buildname: Ubuntu VM 12.04 fx-team opt test marionette-e10s
revision: 46e43ff8cdb5

TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
Return code: 10

Comment 5

[Chris Manchester (limited bugmail, email directly)]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=582b943155df

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1643169
repository: b2g-inbound
start_time: 2015-04-01T17:20:07
who: wkocher[at]mozilla[dot]com
machine: tst-linux32-spot-420
buildname: Ubuntu VM 12.04 b2g-inbound opt test marionette-e10s
revision: 23965fa6570e

TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
Return code: 10

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=6199599
repository: try
start_time: 2015-04-02T05:12:07
who: arai_a[at]mac[dot]com
machine: tst-linux32-spot-735
buildname: Ubuntu VM 12.04 try opt test marionette-e10s
revision: 6a7a1585f7c7

TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_new_tab_window_handles | TimeoutException: TimeoutException: wait_for_condition timed out
TEST-UNEXPECTED-ERROR | test_window_handles.py TestWindowHandles.test_tab_and_window_handles | ValueError: list.remove(x): x not in list
Return code: 10

Comment 8

[Chris Manchester (limited bugmail, email directly)]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=c50c4bd9cf43

Comment 9

[Chris Manchester (limited bugmail, email directly)]

Attachment: MozReview Request: bz://1149843/chmanchester

/r/6569 - Bug 1149843 - Modify test_window_handles not to hit the network.;r=dburns

Pull down this commit:

hg pull -r 8785613ca5389756fb9cde3c120f46c400fdf638 https://reviewboard-hg.mozilla.org/gecko/

Comment 10

[David Burns :automatedtester]

Comment on attachment 8587679 [details]
MozReview Request: bz://1149843/chmanchester

https://reviewboard.mozilla.org/r/6567/#review5635

Ship It!

Comment 11

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/integration/fx-team/rev/6f59be32c489

Comment 12

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/6f59be32c489

Comment 14

[Chris Manchester (limited bugmail, email directly)]

Attachment: MozReview Request: Bug 1149843 - Modify test_window_handles not to hit the network.;r=dburns

Comment 15

[David Burns :automatedtester]

Hasn't been seen in a while so closing

Comment 16

[Firefox Bug Husbandry Bot]

Removing leave-open keyword from resolved bugs, per :sylvestre.

Comment 17

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.