1096517 - Disable stumbler robocop test on 2.3

Status: RESOLVED FIXED

Description

[:garvan]

Bug #1060705 is the stumbler robocop landing.
Bug #986738 is where 2.3 tests were reported failing due to this.

Disabling the test, then investigating.

Comment 1

[:garvan]

Created attachment 8520116 [details] [diff] [review]
bug1096517_disable_robocop_on_2.3.diff

Just added a line to disable on API level 10. 
I'll investigate this today as to _why_ this is happening.

Comment 2

[Geoff Brown [:gbrown]]

Comment on attachment 8520116 [details] [diff] [review]
bug1096517_disable_robocop_on_2.3.diff

Review of attachment 8520116 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks.

It may be difficult to identify a cause. We have had to disable some other robocop tests on 2.3 for unexplained shutdown crashes.

Comment 3

[:garvan]

Thanks for the r+ Geoff, I am going to try and repro this locally and see if I can figure it out.

Comment 4

[:garvan]

Pushed to try a few hours ago:
https://treeherder.mozilla.org/ui/#/jobs?repo=try&revision=ae80a83c004e

Waiting for result...

Comment 5

[:garvan]

Try green from Comment 4

Comment 6

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/integration/fx-team/rev/c371b8e04118

Comment 7

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/c371b8e04118

Comment 8

[:garvan]

Comment on attachment 8520116 [details] [diff] [review]
bug1096517_disable_robocop_on_2.3.diff

Approval Request Comment
[Feature/regressing bug #]: Stumbler for Fennec
[User impact if declined]: None
[Describe test coverage new/current, TBPL]: Bug 1060705 adds a new robocop test, this bug is disabling the failing test on Android 2.3
[Risks and why]: TBPL Android 2.3 robocop test will fail if Bug 1060705 lands without this.
[String/UUID change made/needed]: None.

Comment 9

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/e2fb99d8c833