1317121 - Intermittent test_timeouts.py TestTimeouts.test_search_timeout_found_settimeout | NoSuchElementException: Unable to locate element: newDiv

Status: RESOLVED WONTFIX

(Testing :: Marionette Client and Harness, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=6545523&repo=autoland

https://archive.mozilla.org/pub/firefox/tinderbox-builds/autoland-linux-debug/1479003620/autoland_ubuntu32_vm-debug_test-marionette-bm05-tests1-linux32-build17.txt.gz

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Affected code here:

> button = self.marionette.find_element(By.ID, "createDivButton")
> button.click()
> self.marionette.set_search_timeout(8000)
> self.assertEqual(HTMLElement, type(self.marionette.find_element(By.ID, "newDiv")))

So a click on the createDivButton in test.html will delay the creation of the newDiv div by 2000ms. Maybe calling set_search_timeout was not successful here.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

From gecko.log:

> 1479009963991	Marionette	TRACE	conn755 -> [0,8,"timeouts",{"implicit":8000}]
> 1479009963994	Marionette	TRACE	conn755 <- [1,8,null,{}]
> 1479009964007	Marionette	TRACE	conn755 -> [0,9,"findElement",{"using":"id","value":"newDiv"}]
[..]
> 1479009989855	Marionette	TRACE	conn755 <- [1,9,{"error":"no such element","message":"Unable to locate element: newDiv","stacktrace":""},null]

The timeout used here is 25852ms. What's going on here?

Comment 3

[Andreas Tolfsen ❲:ato❳]

I don’t know.  I don’t have the bandwidth to look at this right now, but this is a likely contender for something to look at next.

Comment 4

[Intermittent Failures Robot]

8 failures in 715 pushes (0.011 failures/push) were associated with this bug in the last 7 days.  

Repository breakdown:
* mozilla-inbound: 3
* mozilla-central: 2
* mozilla-aurora: 2
* autoland: 1

Platform breakdown:
* linux32: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2016-11-14&endday=2016-11-20&tree=all

Comment 6

[Intermittent Failures Robot]

5 failures in 836 pushes (0.006 failures/push) were associated with this bug in the last 7 days.  
Repository breakdown:
* mozilla-inbound: 3
* autoland: 2

Platform breakdown:
* android-4-3-armv7-api15: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-02-06&endday=2017-02-12&tree=all

Comment 7

[Intermittent Failures Robot]

8 failures in 790 pushes (0.01 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 3
* mozilla-central: 2
* autoland: 2
* graphics: 1

Platform breakdown:
* android-4-3-armv7-api15: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-03-06&endday=2017-03-12&tree=all

Comment 8

[Intermittent Failures Robot]

20 failures in 777 pushes (0.026 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 11
* try: 2
* graphics: 2
* oak: 1
* mozilla-release: 1
* mozilla-inbound: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 20

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-03-13&endday=2017-03-19&tree=all

Comment 9

[Intermittent Failures Robot]

10 failures in 845 pushes (0.012 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 3
* mozilla-inbound: 2
* mozilla-central: 2
* mozilla-beta: 2
* mozilla-aurora: 1

Platform breakdown:
* android-4-3-armv7-api15: 10

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-03-27&endday=2017-04-02&tree=all

Comment 10

[Julien Cristau [:jcristau]]

Mass wontfix for bugs affecting firefox 52.

Comment 11

[Geoff Brown [:gbrown]]

Attachment: skip test on Android

This looks just like bug 1306848 - let's handle it the same way.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/73125874d9b9
Skip TestTimeouts.test_search_timeout_found_settimeout on Android; r=ato

Comment 13

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/90043851b77d
https://hg.mozilla.org/releases/mozilla-beta/rev/073ec1b8460a

Comment 14

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/73125874d9b9

Comment 15

[Intermittent Failures Robot]

7 failures in 867 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 2
* mozilla-aurora: 2
* oak: 1
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api15: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-04-03&endday=2017-04-09&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 824 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* windows7-32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1317121&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 17

[Andreas Tolfsen ❲:ato❳]

Only preent on release in the last four months.

Comment 18

[Andreas Tolfsen ❲:ato❳]

Sorry, this was just disabled on Android.

Comment 19

[BugBot [:suhaib / :marco/ :calixte]]

The leave-open keyword is there and there is no activity for 6 months.
:automatedtester, maybe it's time to close this bug?

Comment 20

[David Burns :automatedtester]

This appears to have been reenabled so closing

Comment 21

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to David Burns :automatedtester from comment #20)
> This appears to have been reenabled so closing

We should have a look at the test file at least, which would have revealed that the test is still disabled:

https://searchfox.org/mozilla-central/rev/d35199ef15ffa57d190886e20d5df6471faf0870/testing/marionette/harness/marionette_harness/tests/unit/test_timeouts.py#48

Not sure if intermittent bugs are still being closed automatically even with the disabled keyword set. As such I will set leave-open again.

Comment 22

[Henrik Skupin [:whimboo][⌚️UTC+2]]

We should be able to unskip this patch once we moved the Mn jobs to the new and faster Android 7.0 x86 emulator, which is done on bug 1500509.

Comment 23

[Henrik Skupin [:whimboo][⌚️UTC+2]]

We moved away from the ARM platform and this failure no longer occurs on packet.net with Android 7.0 x86_64.

Comment 24

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.