948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Status: RESOLVED DUPLICATE of bug 1216257

(Firefox for Android Graveyard :: General, defect)

Description

[Geoff Brown [:gbrown]]

This may be specific to the Android 4.2 x86 emu environment.

https://tbpl.mozilla.org/php/getParsedLog.php?id=31753471&tree=Cedar&full=1

10:09:50     INFO -  0 INFO SimpleTest START
10:09:50     INFO -  1 INFO TEST-START | testClearPrivateData
10:09:50     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - Gecko:Ready should equal Gecko:Ready
10:09:50     INFO -  EventExpecter: no longer listening for Gecko:Ready
10:09:50     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
10:09:50     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
10:09:50     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
10:09:50     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
10:09:50     INFO -  9 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - Sanitize:Finished should equal Sanitize:Finished
10:09:50     INFO -  EventExpecter: no longer listening for Sanitize:Finished
10:09:50     INFO -  10 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
10:09:50     INFO -  11 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 0 history items present in the database
10:09:50     INFO -  12 INFO TEST-PASS | testClearPrivateData | Checking that bookmarks have not been removed - User made bookmarks were not removed with private data
10:09:50     INFO -  13 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  14 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
10:09:50     INFO -  15 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  16 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
10:09:50     INFO -  17 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
10:09:50     INFO -  18 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  19 INFO TEST-PASS | testClearPrivateData | Verify that the option: Share is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  20 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  21 INFO TEST-PASS | testClearPrivateData | Verify that the option: There are no settings to clear is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  22 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  23 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
10:09:50     INFO -  24 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  25 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
10:09:50     INFO -  26 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
10:09:50     INFO -  27 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  28 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  waitForText timeout on ^Settings$
10:09:50     INFO -  waitForText timeout on ^Settings$
10:09:50     INFO -  Exception caught during test!
10:09:50     INFO -  junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
10:09:50     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
10:09:50     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
10:09:50     INFO -  	at com.jayway.android.robotium.solo.Clicker.clickOnText(Clicker.java:381)
10:09:50     INFO -  	at com.jayway.android.robotium.solo.Solo.clickOnText(Solo.java:1022)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectMenuItem(BaseTest.java:486)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectMenuItemByPath(BaseTest.java:460)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.selectMenuItemByPath(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectSettingsItem(BaseTest.java:451)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.selectSettingsItem(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.clearPrivateData(BaseTest.java:687)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearPrivateData(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:86)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:71)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:26)
10:09:50     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
10:09:50     INFO -  	at java.lang.reflect.Method.invoke(Method.java:511)
10:09:50     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
10:09:50     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
10:09:50     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:150)
10:09:50     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
10:09:50     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
10:09:50     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
10:09:50     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
10:09:50     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
10:09:50     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:190)
10:09:50     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:175)
10:09:50     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:555)
10:09:50     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1661)
10:09:50     INFO -  29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
10:09:50     INFO -  30 INFO TEST-END | testClearPrivateData | finished in 112105ms
10:09:50     INFO -  31 INFO TEST-START | Shutdown
10:09:50     INFO -  32 INFO Passed: 27
10:09:50  WARNING -  33 INFO Failed: 1
10:09:50  WARNING -  One or more unittests failed.
10:09:50     INFO -  34 INFO Todo: 0
10:09:50     INFO -  35 INFO SimpleTest FINISHED
10:09:50     INFO -  INFO | automation.py | Application ran for: 0:01:55.027859

Comment 1

[Geoff Brown [:gbrown]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=31717322&tree=Cedar&full=1

Comment 2

[Geoff Brown [:gbrown]]

Disabled on Android x86 only.

https://hg.mozilla.org/integration/mozilla-inbound/rev/8a661fd11085

Comment 3

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/8a661fd11085

Comment 4

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=34945375&tree=Mozilla-Inbound
Android 4.0 Panda mozilla-inbound opt test robocop-1 on 2014-02-19 15:48:31
revision: 892751e80036
slave: panda-0436

29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
02-19 16:22:01.710 I/Robocop ( 4085): 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
02-19 16:22:03.031 I/TestRunner( 4085): junit.framework.AssertionFailedError: 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
02-19 16:22:01.710 I/Robocop ( 4085): 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
02-19 16:22:03.031 I/TestRunner( 4085): junit.framework.AssertionFailedError: 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
Return code: 1
02-19 16:22:01.710 I/Robocop ( 4085): 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
02-19 16:22:03.031 I/TestRunner( 4085): junit.framework.AssertionFailedError: 29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Comment 5

[Geoff Brown [:gbrown]]

This also happens on the up-coming Android 2.3 emulator in just the same way:

https://tbpl.mozilla.org/php/getParsedLog.php?id=34518484&tree=Ash&full=1#error14

16:00:20     INFO -  02-11 15:34:36.744 W/InputManagerService(   65): Window already focused, ignoring focus gain of: com.android.internal.view.IInputMethodClient$Stub$Proxy@40836e38
16:00:20     INFO -  02-11 15:34:38.430 I/Robocop ( 2028): 29 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
16:00:20     INFO -  02-11 15:34:39.385 E/Profiler( 2028): BPUnw: [6 total] thread_unregister_for_profiling(me=0x394cf0) 
16:00:20     INFO -  02-11 15:34:39.647 W/KeyCharacterMap( 2028): No keyboard for id 0
16:00:20     INFO -  02-11 15:34:39.647 W/KeyCharacterMap( 2028): Using default keymap: /system/usr/keychars/qwerty.kcm.bin
16:00:20     INFO -  02-11 15:34:39.823 W/InputManagerService(   65): Window already focused, ignoring focus gain of: com.android.internal.view.IInputMethodClient$Stub$Proxy@4069f3d8
16:00:20     INFO -  02-11 15:34:48.865 I/dalvikvm( 2028): Jit: resizing JitTable from 4096 to 8192
16:00:20     INFO -  02-11 15:34:52.821 E/Profiler( 2028): BPUnw: [5 total] thread_unregister_for_profiling(me=0x2e12b0) 
16:00:20     INFO -  02-11 15:35:00.039 I/Robocop ( 2028): waitForText timeout on ^Settings$
16:00:20     INFO -  02-11 15:35:26.792 I/Robocop ( 2028): waitForText timeout on ^Settings$
16:00:20     INFO -  02-11 15:35:37.782 D/Robotium( 2028): '^Settings$' not found. Have found: '1'
16:00:20     INFO -  02-11 15:35:37.782 D/Robotium( 2028): '^Settings$' not found. Have found: 'Geolocation Test Page'
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): Exception caught during test!
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.Assert.fail(Assert.java:47)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.Assert.assertTrue(Assert.java:20)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at com.jayway.android.robotium.solo.Clicker.clickOnText(Clicker.java:383)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at com.jayway.android.robotium.solo.Solo.clickOnText(Solo.java:1028)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectMenuItem(BaseTest.java:486)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectMenuItemByPath(BaseTest.java:460)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.selectMenuItemByPath(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectSettingsItem(BaseTest.java:451)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.selectSettingsItem(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.clearPrivateData(BaseTest.java:687)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.clearPrivateData(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:86)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:71)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:26)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at java.lang.reflect.Method.invokeNative(Native Method)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at java.lang.reflect.Method.invoke(Method.java:507)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:150)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestCase.runBare(TestCase.java:127)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult$1.protect(TestResult.java:106)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult.runProtected(TestResult.java:124)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult.run(TestResult.java:109)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestCase.run(TestCase.java:118)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
16:00:20     INFO -  02-11 15:35:38.087 I/Robocop ( 2028): 30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Comment 7

[Geoff Brown [:gbrown]]

Disabled on 2.3 also: https://hg.mozilla.org/integration/mozilla-inbound/rev/c15e756134d7

Comment 8

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/c15e756134d7

Comment 9

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=37589521&tree=B2g-Inbound
Android 2.2 Armv6 Tegra b2g-inbound opt test robocop-1 on 2014-04-10 11:12:17
revision: 79fd67cd654a
slave: tegra-256

46 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!
04-10 11:56:07.813 I/Robocop ( 5321): 46 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!

Comment 10

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=37669605&tree=Fx-Team
Android 2.2 Armv6 Tegra fx-team opt test robocop-1 on 2014-04-11 17:12:28
revision: 296776ed5d4b
slave: tegra-110

30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!
04-11 17:54:48.416 I/Robocop ( 5253): 30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!

Comment 11

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=37673472&tree=Fx-Team
Android 2.2 Tegra fx-team opt test robocop-1 on 2014-04-11 18:42:17
revision: 745e3881973e
slave: tegra-235

30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!
04-11 19:18:04.328 I/Robocop ( 5012): 30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!

Comment 12

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=38024735&tree=Mozilla-Inbound
Android 2.2 Armv6 Tegra mozilla-inbound opt test robocop-1 on 2014-04-17 09:32:19
revision: a0aa1d05d7cf
slave: tegra-188

45 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!
04-17 10:16:02.585 I/Robocop ( 5143): 45 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!

Comment 13

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=38133164&tree=Mozilla-Inbound
Android 2.2 Armv6 Tegra mozilla-inbound opt test robocop-1 on 2014-04-18 21:41:26
revision: 8a8c87fcd2d9
slave: tegra-098

46 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!
04-18 22:25:10.872 I/Robocop ( 5379): 46 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: 'Clear data' is not found!

Comment 14

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

I wonder if "^Settings$" just isn't off-screen in the emulator...

Comment 15

[Geoff Brown [:gbrown]]

I tried re-enabling this on 2.3 and got a different error:

https://tbpl.mozilla.org/php/getParsedLog.php?id=41585120&tree=Ash&full=1#error7

00:57:33     INFO -  1 INFO TEST-START | testClearPrivateData
00:57:33     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready
00:57:33     INFO -  EventExpecter: no longer listening for Gecko:Ready
00:57:33     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:57:33     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
00:57:33     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:57:33     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:57:33     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:57:33     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
00:57:33     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
00:57:33     INFO -  waitForText timeout on ^Settings$
00:57:33     INFO -  9 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:57:33     INFO -  10 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:57:33     INFO -  11 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:57:33     INFO -  12 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:57:33     INFO -  13 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:57:33     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:57:33     INFO -  14 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:57:33     INFO -  Exception caught during test!
00:57:33     INFO -  junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:57:33     INFO -  	at junit.framework.Assert.fail(Assert.java:47)
00:57:33     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
00:57:33     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1990)
00:57:33     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1970)
00:57:33     INFO -  	at org.mozilla.gecko.tests.BaseTest.verifyPageTitle(BaseTest.java:481)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:87)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearHistory(testClearPrivateData.java:40)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:21)
00:57:33     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
00:57:33     INFO -  	at java.lang.reflect.Method.invoke(Method.java:507)
00:57:33     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
00:57:33     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
00:57:33     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
00:57:33     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:125)
00:57:33     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:127)
00:57:33     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:106)
00:57:33     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:124)
00:57:33     INFO -  	at junit.framework.TestResult.run(TestResult.java:109)
00:57:33     INFO -  	at junit.framework.TestCase.run(TestCase.java:118)
00:57:33     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
00:57:33     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
00:57:33     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
00:57:33     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
00:57:33     INFO -  15 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:57:33     INFO -  16 INFO TEST-END | testClearPrivateData | finished in 79014ms

Comment 16

[Geoff Brown [:gbrown]]

Also https://tbpl.mozilla.org/php/getParsedLog.php?id=41584706&tree=Ash&full=1#error8

00:48:23     INFO -  1 INFO TEST-START | testClearPrivateData
00:48:23     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready
00:48:23     INFO -  EventExpecter: no longer listening for Gecko:Ready
00:48:23     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
00:48:23     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:48:23     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
00:48:23     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
00:48:23     INFO -  waitForText timeout on ^Settings$
00:48:23     INFO -  9 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:48:23     INFO -  10 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:48:23     INFO -  11 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:48:23     INFO -  12 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:48:23     INFO -  13 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:48:23     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:48:23     INFO -  14 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:48:23     INFO -  15 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:48:23     INFO -  16 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 0 history items present in the database
00:48:23     INFO -  17 INFO TEST-PASS | testClearPrivateData | Checking that bookmarks have not been removed - User made bookmarks were not removed with private data
00:48:23     INFO -  18 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  19 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
00:48:23     INFO -  20 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  21 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
00:48:23     INFO -  22 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
00:48:23     INFO -  23 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  24 INFO TEST-PASS | testClearPrivateData | Verify that the option: Share is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  25 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  26 INFO TEST-PASS | testClearPrivateData | Verify that the option: There are no settings to clear is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  27 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  28 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
00:48:23     INFO -  29 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  30 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
00:48:23     INFO -  31 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
00:48:23     INFO -  32 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  33 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  waitForText timeout on ^Settings$
00:48:23     INFO -  34 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:48:23     INFO -  35 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:48:23     INFO -  36 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:48:23     INFO -  37 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:48:23     INFO -  38 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:48:23     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:48:23     INFO -  39 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:48:23     INFO -  Exception caught during test!
00:48:23     INFO -  junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:48:23     INFO -  	at junit.framework.Assert.fail(Assert.java:47)
00:48:23     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
00:48:23     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1990)
00:48:23     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1970)
00:48:23     INFO -  	at org.mozilla.gecko.tests.BaseTest.verifyPageTitle(BaseTest.java:481)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:87)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:67)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:22)
00:48:23     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
00:48:23     INFO -  	at java.lang.reflect.Method.invoke(Method.java:507)
00:48:23     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
00:48:23     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
00:48:23     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
00:48:23     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:125)
00:48:23     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:127)
00:48:23     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:106)
00:48:23     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:124)
00:48:23     INFO -  	at junit.framework.TestResult.run(TestResult.java:109)
00:48:23     INFO -  	at junit.framework.TestCase.run(TestCase.java:118)
00:48:23     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
00:48:23     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
00:48:23     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
00:48:23     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
00:48:23     INFO -  40 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:48:23     INFO -  41 INFO TEST-END | testClearPrivateData | finished in 159889ms

Comment 17

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=46719846&tree=B2g-Inbound
Android 4.0 Panda b2g-inbound opt test robocop-1 on 2014-08-25 14:39:53
revision: 25338e7384da
slave: panda-0170

752 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
08-25 15:08:17.195 E/GeckoLinker( 4475): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
08-25 15:10:34.601 E/GeckoLinker( 4713): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
Return code: 1
08-25 15:10:34.601 E/GeckoLinker( 4713): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported

Comment 18

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Not actively working on this.

Comment 19

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=48258340&tree=Mozilla-Inbound
Android 4.0 Panda mozilla-inbound opt test robocop-1 on 2014-09-16 20:56:55
revision: 72b7c1efb2b5
slave: panda-0113

TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
09-16 21:33:28.390 E/GeckoLinker( 4736): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
Return code: 1
09-16 21:33:28.390 E/GeckoLinker( 4736): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported

Comment 20

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-24T07:25:48
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=4154925
repository: mozilla-inbound
who: tomcat[at]mozilla[dot]com
machine: panda-0470
buildname: Android 4.0 Panda mozilla-inbound opt test robocop-2
revision: 252b954764ee

11/24/2014 06:56:21: DEBUG:  9524 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0479/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0479
11/24/2014 06:56:21: DEBUG:  9532 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0482/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0482
11/24/2014 06:56:21: DEBUG:  9536 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0476/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0476
TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
11-24 07:06:13.820 E/GeckoLinker( 2360): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
Return code: 1
11-24 07:19:17.242 E/GeckoLinker( 4329): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported

Comment 21

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-24T15:27:17
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=fx-team&job_id=1278159
repository: fx-team
who: wkocher[at]mozilla[dot]com
machine: panda-0586
buildname: Android 4.0 Panda fx-team opt test robocop-2
revision: 8ec21ff65ce3

11/24/2014 14:34:12: DEBUG: 27503 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0584/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0584
11/24/2014 14:34:12: DEBUG: 27614 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0587/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0587
11/24/2014 14:34:12: DEBUG: 27616 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0592/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0592
11/24/2014 14:34:12: DEBUG: 27619 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0590/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0590
11/24/2014 14:34:12: DEBUG: 27636 ?        S      0:00 python /builds/tools/buildfarm/mobile/../utils/retry.py --stderr-regexp ERROR 404: Not Found --fail-if-match wget -q -O/builds/panda-0588/buildbot.tac.new http://slavealloc.pvt.build.mozilla.org/gettac/panda-0588
TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
11-24 22:45:47.149 E/GeckoLinker( 2031): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
Return code: 1
11-24 22:58:15.953 E/GeckoLinker( 4009): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
mozdevice.devicemanagerSUT.AgentError: Automation Error: Timeout in command execext su t=3600 logcat -v time

Comment 22

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-12-24T18:00:38
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=b2g-inbound&job_id=1059802
repository: b2g-inbound
who: philringnalda[at]gmail[dot]com
machine: panda-0069
buildname: Android 4.0 armv7 API 10+ b2g-inbound opt test robocop-2
revision: 2acb12da9813

TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Page$' is not found!
12-24 17:39:11.921 E/GeckoLinker( 2542): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported
Return code: 1
12-24 17:52:14.968 E/GeckoLinker( 4347): /data/data/com.adobe.flashplayer/lib/libysshared.so: Text relocations are not supported

Comment 23

[Jonathan Almeida [:jonalmeida]]

I think I may have found the root of this problem as well as why some of my other robocop tests aren't working.

In `BaseTest.selectMenuItem` we open the menu with `mActions.sendSpecialKey(Actions.SpecialKey.MENU)`. On the Android 4.0+ this doesn't seem to work well. The alternative that seems to work, is using `Solo.clickOnMenuItem` which opens the menu for us and then clicks on the item in the list.

Will try and grab this later.

Comment 24

[Jonathan Almeida [:jonalmeida]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=2a8f2c062f0a

Comment 25

[Jonathan Almeida [:jonalmeida]]

Attachment: MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Comment 26

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

(In reply to Jonathan Almeida [:jonalmeida] from comment #24)
> https://treeherder.mozilla.org/#/jobs?repo=try&revision=2a8f2c062f0a

Btw, when fixing an intermittent and you're not confident you have the fix, it can be good idea to retrigger the suites a few times over, just to check the error doesn't occur again.

Comment 27

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Comment on attachment 8637050 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/13787/#review12559

::: build/mobile/robocop/FennecNativeActions.java:370
(Diff revision 1)
> -        mInstr.sendCharacterSync(keyCode);
> +        mSolo.sendKey(keyCode);

According to [the docs](http://robotium.googlecode.com/svn/doc/com/robotium/solo/Solo.html#sendKey%28int%29), this is only supposed to be used with Solo.LEFT/RIGHT/etc.

Do you disagree?

Comment 28

[Jonathan Almeida [:jonalmeida]]

https://reviewboard.mozilla.org/r/13787/#review12559

> According to [the docs](http://robotium.googlecode.com/svn/doc/com/robotium/solo/Solo.html#sendKey%28int%29), this is only supposed to be used with Solo.LEFT/RIGHT/etc.
> 
> Do you disagree?

No, this looks right. In our FennecNativeActions, we only use those directions (with the exception of DELETE which we don't support): http://mxr.mozilla.org/mozilla-central/source/build/mobile/robocop/FennecNativeActions.java#337

Side note: KeyEvent.KEYCODE_DPAD_UP == Solo.UP (i.e. they send the same keycode values).

Comment 29

[Jonathan Almeida [:jonalmeida]]

(In reply to Michael Comella (:mcomella) from comment #26)
> Btw, when fixing an intermittent and you're not confident you have the fix,
> it can be good idea to retrigger the suites a few times over, just to check
> the error doesn't occur again.

Ah, good point. I'm going to run it a couple more times with that that other try message for robocop.

Comment 30

[Jonathan Almeida [:jonalmeida]]

I've run try a couple more times and I've seeing green everywhere. Pushing for review again.

https://treeherder.mozilla.org/#/jobs?repo=try&revision=af6c9cb5e751
https://treeherder.mozilla.org/#/jobs?repo=try&revision=502ea7ef5594

Comment 31

[Jonathan Almeida [:jonalmeida]]

Attachment: MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Comment 32

[Jonathan Almeida [:jonalmeida]]

Realized the previous review got discarded and didn't get feedback about the comments from the last review.

Comment 33

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/15965/#review14357

::: build/mobile/robocop/FennecNativeActions.java:370
(Diff revision 1)
> -        mInstr.sendCharacterSync(keyCode);
> +        mSolo.sendKey(keyCode);

Under the hood, [robotium uses sendCharacterSync](https://github.com/RobotiumTech/robotium/blob/master/robotium-solo/src/main/java/com/robotium/solo/Sender.java#L43), but notably sleeps before calling it (and catches the exception it may throw).

Why do you think using Solo makes a difference? I'm heisitant because they're documentation suggests we shouldn't supply random key codes - I'd rather just copy their code, just in case they change their code to only support those key codes.

Comment 34

[Jonathan Almeida [:jonalmeida]]

https://reviewboard.mozilla.org/r/15965/#review14357

> Under the hood, [robotium uses sendCharacterSync](https://github.com/RobotiumTech/robotium/blob/master/robotium-solo/src/main/java/com/robotium/solo/Sender.java#L43), but notably sleeps before calling it (and catches the exception it may throw).
> 
> Why do you think using Solo makes a difference? I'm heisitant because they're documentation suggests we shouldn't supply random key codes - I'd rather just copy their code, just in case they change their code to only support those key codes.

> Why do you think using Solo makes a difference?

From local testing and a few re-runs of tests on try, I've seen fewer test failures where buttons are not found. There isn't hard evidence for it, but I don't think there is any disadvantage to using Solo's wrapper around sending the key events. For now, it only includes a short sleep before clicking, but it's a wee bit less overhead off of us :)

> I'm heisitant because they're documentation suggests we shouldn't supply random key codes

I mentioned this in the previous review (but it seems to have gone missing somewhere) that we limit the key codes we send to the same filtered ones (D pad keys) that [robotium sends][1]. See [here][2].

We definitely can add the sleep and try-catch to our sendKey() method instead I guess.. ¯\_(ツ)_/¯

[1]: https://github.com/RobotiumTech/robotium/blob/79952a5d88c15c2cc4907a1b9945f340e37d2647/robotium-solo/src/main/java/com/robotium/solo/Solo.java#L79
[2]: https://dxr.mozilla.org/mozilla-central/source/build/mobile/robocop/FennecNativeActions.java#337

Comment 35

[Jonathan Almeida [:jonalmeida]]

Need info so this doesn't get lost again.

Comment 36

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

(In reply to Jonathan Almeida (:jonalmeida) from comment #34)
> > I'm heisitant because they're documentation suggests we shouldn't supply random key codes
> 
> I mentioned this in the previous review (but it seems to have gone missing
> somewhere) that we limit the key codes we send to the same filtered ones (D
> pad keys) that [robotium sends][1]. See [here][2].

Fair enough. If you update those key code references to the Solo values (e.g. Solo.RIGHT, or whatever), then I agree with moving to Solo.

Comment 37

[Jonathan Almeida [:jonalmeida]]

Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Comment 38

[Jonathan Almeida [:jonalmeida]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=16fafc3e6d0d

Comment 39

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

See comment 36.

Comment 40

[Jonathan Almeida [:jonalmeida]]

Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Comment 41

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/15965/#review14611

Thanks.

Comment 42

[Pulsebot]

https://hg.mozilla.org/integration/fx-team/rev/0ec4b789a173

Comment 43

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/0ec4b789a173

Comment 44

[Matteo Ferretti [:zer0] [:matteo]]

Attachment: Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Comment 45

[Matteo Ferretti [:zer0] [:matteo]]

Comment on attachment 8649791 [details] [diff] [review]
Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Removed 'cause added by mistake from git bz.

Comment 46

[Geoff Brown [:gbrown]]

This test has been deleted.