Closed Bug 948591 Opened 10 years ago Closed 8 years ago

Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Categories

(Firefox for Android Graveyard :: General, defect)

Product:
Firefox for Android Graveyard
Component:
General
Platform:
x86
macOS
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1216257

People

(Reporter: gbrown, Assigned: gbrown)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file, 2 obsolete files)

MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella
40 bytes, text/x-review-board-request
mcomella
: review+
Details 
This may be specific to the Android 4.2 x86 emu environment.

https://tbpl.mozilla.org/php/getParsedLog.php?id=31753471&tree=Cedar&full=1

10:09:50     INFO -  0 INFO SimpleTest START
10:09:50     INFO -  1 INFO TEST-START | testClearPrivateData
10:09:50     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - Gecko:Ready should equal Gecko:Ready
10:09:50     INFO -  EventExpecter: no longer listening for Gecko:Ready
10:09:50     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
10:09:50     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
10:09:50     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
10:09:50     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
10:09:50     INFO -  9 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - Sanitize:Finished should equal Sanitize:Finished
10:09:50     INFO -  EventExpecter: no longer listening for Sanitize:Finished
10:09:50     INFO -  10 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
10:09:50     INFO -  11 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 0 history items present in the database
10:09:50     INFO -  12 INFO TEST-PASS | testClearPrivateData | Checking that bookmarks have not been removed - User made bookmarks were not removed with private data
10:09:50     INFO -  13 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  14 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
10:09:50     INFO -  15 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  16 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
10:09:50     INFO -  17 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
10:09:50     INFO -  18 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  19 INFO TEST-PASS | testClearPrivateData | Verify that the option: Share is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  20 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  21 INFO TEST-PASS | testClearPrivateData | Verify that the option: There are no settings to clear is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  22 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
10:09:50     INFO -  23 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
10:09:50     INFO -  24 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event - DOMContentLoaded should equal DOMContentLoaded
10:09:50     INFO -  EventExpecter: no longer listening for DOMContentLoaded
10:09:50     INFO -  25 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
10:09:50     INFO -  26 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
10:09:50     INFO -  27 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was openend
10:09:50     INFO -  28 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
10:09:50     INFO -  waitForText timeout on ^Settings$
10:09:50     INFO -  waitForText timeout on ^Settings$
10:09:50     INFO -  Exception caught during test!
10:09:50     INFO -  junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
10:09:50     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
10:09:50     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
10:09:50     INFO -  	at com.jayway.android.robotium.solo.Clicker.clickOnText(Clicker.java:381)
10:09:50     INFO -  	at com.jayway.android.robotium.solo.Solo.clickOnText(Solo.java:1022)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectMenuItem(BaseTest.java:486)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectMenuItemByPath(BaseTest.java:460)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.selectMenuItemByPath(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.selectSettingsItem(BaseTest.java:451)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.selectSettingsItem(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.clearPrivateData(BaseTest.java:687)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearPrivateData(testClearPrivateData.java:15)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:86)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:71)
10:09:50     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:26)
10:09:50     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
10:09:50     INFO -  	at java.lang.reflect.Method.invoke(Method.java:511)
10:09:50     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
10:09:50     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
10:09:50     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
10:09:50     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:150)
10:09:50     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
10:09:50     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
10:09:50     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
10:09:50     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
10:09:50     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
10:09:50     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:190)
10:09:50     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:175)
10:09:50     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:555)
10:09:50     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1661)
10:09:50     INFO -  29 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
10:09:50     INFO -  30 INFO TEST-END | testClearPrivateData | finished in 112105ms
10:09:50     INFO -  31 INFO TEST-START | Shutdown
10:09:50     INFO -  32 INFO Passed: 27
10:09:50  WARNING -  33 INFO Failed: 1
10:09:50  WARNING -  One or more unittests failed.
10:09:50     INFO -  34 INFO Todo: 0
10:09:50     INFO -  35 INFO SimpleTest FINISHED
10:09:50     INFO -  INFO | automation.py | Application ran for: 0:01:55.027859
Keywords: intermittent-failure
Disabled on Android x86 only.

https://hg.mozilla.org/integration/mozilla-inbound/rev/8a661fd11085
Whiteboard: [test disabled][leave open]
This also happens on the up-coming Android 2.3 emulator in just the same way:

https://tbpl.mozilla.org/php/getParsedLog.php?id=34518484&tree=Ash&full=1#error14

16:00:20     INFO -  02-11 15:34:36.744 W/InputManagerService(   65): Window already focused, ignoring focus gain of: com.android.internal.view.IInputMethodClient$Stub$Proxy@40836e38
16:00:20     INFO -  02-11 15:34:38.430 I/Robocop ( 2028): 29 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
16:00:20     INFO -  02-11 15:34:39.385 E/Profiler( 2028): BPUnw: [6 total] thread_unregister_for_profiling(me=0x394cf0) 
16:00:20     INFO -  02-11 15:34:39.647 W/KeyCharacterMap( 2028): No keyboard for id 0
16:00:20     INFO -  02-11 15:34:39.647 W/KeyCharacterMap( 2028): Using default keymap: /system/usr/keychars/qwerty.kcm.bin
16:00:20     INFO -  02-11 15:34:39.823 W/InputManagerService(   65): Window already focused, ignoring focus gain of: com.android.internal.view.IInputMethodClient$Stub$Proxy@4069f3d8
16:00:20     INFO -  02-11 15:34:48.865 I/dalvikvm( 2028): Jit: resizing JitTable from 4096 to 8192
16:00:20     INFO -  02-11 15:34:52.821 E/Profiler( 2028): BPUnw: [5 total] thread_unregister_for_profiling(me=0x2e12b0) 
16:00:20     INFO -  02-11 15:35:00.039 I/Robocop ( 2028): waitForText timeout on ^Settings$
16:00:20     INFO -  02-11 15:35:26.792 I/Robocop ( 2028): waitForText timeout on ^Settings$
16:00:20     INFO -  02-11 15:35:37.782 D/Robotium( 2028): '^Settings$' not found. Have found: '1'
16:00:20     INFO -  02-11 15:35:37.782 D/Robotium( 2028): '^Settings$' not found. Have found: 'Geolocation Test Page'
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): Exception caught during test!
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.Assert.fail(Assert.java:47)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.Assert.assertTrue(Assert.java:20)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at com.jayway.android.robotium.solo.Clicker.clickOnText(Clicker.java:383)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at com.jayway.android.robotium.solo.Solo.clickOnText(Solo.java:1028)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectMenuItem(BaseTest.java:486)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectMenuItemByPath(BaseTest.java:460)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.selectMenuItemByPath(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.selectSettingsItem(BaseTest.java:451)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.selectSettingsItem(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.clearPrivateData(BaseTest.java:687)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.clearPrivateData(testClearPrivateData.java:15)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:86)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:71)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:26)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at java.lang.reflect.Method.invokeNative(Native Method)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at java.lang.reflect.Method.invoke(Method.java:507)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:150)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestCase.runBare(TestCase.java:127)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult$1.protect(TestResult.java:106)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult.runProtected(TestResult.java:124)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestResult.run(TestResult.java:109)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at junit.framework.TestCase.run(TestCase.java:118)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
16:00:20     INFO -  02-11 15:35:38.054 I/Robocop ( 2028): 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
16:00:20     INFO -  02-11 15:35:38.087 I/Robocop ( 2028): 30 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!
Blocks: 967704
Blocks: 979921
No longer blocks: 967704
I wonder if "^Settings$" just isn't off-screen in the emulator...
Assignee: nobody → michael.l.comella
Status: NEW → ASSIGNED
I tried re-enabling this on 2.3 and got a different error:

https://tbpl.mozilla.org/php/getParsedLog.php?id=41585120&tree=Ash&full=1#error7

00:57:33     INFO -  1 INFO TEST-START | testClearPrivateData
00:57:33     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready
00:57:33     INFO -  EventExpecter: no longer listening for Gecko:Ready
00:57:33     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:57:33     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
00:57:33     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:57:33     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:57:33     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:57:33     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
00:57:33     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
00:57:33     INFO -  waitForText timeout on ^Settings$
00:57:33     INFO -  9 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:57:33     INFO -  10 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:57:33     INFO -  11 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:57:33     INFO -  12 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:57:33     INFO -  13 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:57:33     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:57:33     INFO -  14 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:57:33     INFO -  Exception caught during test!
00:57:33     INFO -  junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:57:33     INFO -  	at junit.framework.Assert.fail(Assert.java:47)
00:57:33     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
00:57:33     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1990)
00:57:33     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1970)
00:57:33     INFO -  	at org.mozilla.gecko.tests.BaseTest.verifyPageTitle(BaseTest.java:481)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:87)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearHistory(testClearPrivateData.java:40)
00:57:33     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:21)
00:57:33     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
00:57:33     INFO -  	at java.lang.reflect.Method.invoke(Method.java:507)
00:57:33     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
00:57:33     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
00:57:33     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
00:57:33     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:125)
00:57:33     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:127)
00:57:33     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:106)
00:57:33     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:124)
00:57:33     INFO -  	at junit.framework.TestResult.run(TestResult.java:109)
00:57:33     INFO -  	at junit.framework.TestCase.run(TestCase.java:118)
00:57:33     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
00:57:33     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
00:57:33     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
00:57:33     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
00:57:33     INFO -  15 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:57:33     INFO -  16 INFO TEST-END | testClearPrivateData | finished in 79014ms
Also https://tbpl.mozilla.org/php/getParsedLog.php?id=41584706&tree=Ash&full=1#error8

00:48:23     INFO -  1 INFO TEST-START | testClearPrivateData
00:48:23     INFO -  2 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready
00:48:23     INFO -  EventExpecter: no longer listening for Gecko:Ready
00:48:23     INFO -  3 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  4 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_blank_01.html should equal http://mochi.test:8888/tests/robocop/robocop_blank_01.html
00:48:23     INFO -  5 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  6 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:48:23     INFO -  7 INFO TEST-PASS | testClearPrivateData | Inserting/updating a new bookmark - Inserting/updating the bookmark with the title = Browser Blank Page 02 and the url = http://mochi.test:8888/tests/robocop/robocop_blank_02.html
00:48:23     INFO -  8 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 1 history items present in the database
00:48:23     INFO -  waitForText timeout on ^Settings$
00:48:23     INFO -  9 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:48:23     INFO -  10 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:48:23     INFO -  11 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:48:23     INFO -  12 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:48:23     INFO -  13 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:48:23     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:48:23     INFO -  14 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:48:23     INFO -  15 INFO TEST-PASS | testClearPrivateData | Page title is correct - Browser Blank Page 01 should equal Browser Blank Page 01
00:48:23     INFO -  16 INFO TEST-PASS | testClearPrivateData | Checking that the number of history items is correct - 0 history items present in the database
00:48:23     INFO -  17 INFO TEST-PASS | testClearPrivateData | Checking that bookmarks have not been removed - User made bookmarks were not removed with private data
00:48:23     INFO -  18 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  19 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
00:48:23     INFO -  20 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  21 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
00:48:23     INFO -  22 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
00:48:23     INFO -  23 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  24 INFO TEST-PASS | testClearPrivateData | Verify that the option: Share is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  25 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  26 INFO TEST-PASS | testClearPrivateData | Verify that the option: There are no settings to clear is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  27 INFO TEST-PASS | testClearPrivateData | waiting for urlbar text to gain focus - urlbar text gained focus
00:48:23     INFO -  28 INFO TEST-PASS | testClearPrivateData | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_geolocation.html should equal http://mochi.test:8888/tests/robocop/robocop_geolocation.html
00:48:23     INFO -  29 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
00:48:23     INFO -  EventExpecter: no longer listening for DOMContentLoaded
00:48:23     INFO -  30 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been displayed - true should equal true
00:48:23     INFO -  31 INFO TEST-PASS | testClearPrivateData | Doorhanger:Share your location with has been hidden - false should equal false
00:48:23     INFO -  32 INFO TEST-PASS | testClearPrivateData | Waiting for the pop-up to open - Pop up was opened
00:48:23     INFO -  33 INFO TEST-PASS | testClearPrivateData | Verify that the option: Don't share is in the list - The option is in the list. There are settings to clear
00:48:23     INFO -  waitForText timeout on ^Settings$
00:48:23     INFO -  34 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
00:48:23     INFO -  35 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
00:48:23     INFO -  36 INFO TEST-PASS | testClearPrivateData | Waiting for and scrolling once to find item ^Clear private data$ - ^Clear private data$ found
00:48:23     INFO -  37 INFO TEST-PASS | testClearPrivateData | Waiting for enabled text ^Clear private data$ - ^Clear private data$ option is present and enabled
00:48:23     INFO -  38 INFO TEST-PASS | testClearPrivateData | Given message occurred for registered event: {"type":"Sanitize:Finished","success":true} - Sanitize:Finished should equal Sanitize:Finished
00:48:23     INFO -  EventExpecter: no longer listening for Sanitize:Finished
00:48:23     INFO -  39 INFO TEST-PASS | testClearPrivateData | waiting to perform one back - one back
00:48:23     INFO -  Exception caught during test!
00:48:23     INFO -  junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:48:23     INFO -  	at junit.framework.Assert.fail(Assert.java:47)
00:48:23     INFO -  	at junit.framework.Assert.assertTrue(Assert.java:20)
00:48:23     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1990)
00:48:23     INFO -  	at com.jayway.android.robotium.solo.Solo.getView(Solo.java:1970)
00:48:23     INFO -  	at org.mozilla.gecko.tests.BaseTest.verifyPageTitle(BaseTest.java:481)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.checkDevice(testClearPrivateData.java:87)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.clearSiteSettings(testClearPrivateData.java:67)
00:48:23     INFO -  	at org.mozilla.gecko.tests.testClearPrivateData.testClearPrivateData(testClearPrivateData.java:22)
00:48:23     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
00:48:23     INFO -  	at java.lang.reflect.Method.invoke(Method.java:507)
00:48:23     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
00:48:23     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
00:48:23     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
00:48:23     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:125)
00:48:23     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:127)
00:48:23     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:106)
00:48:23     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:124)
00:48:23     INFO -  	at junit.framework.TestResult.run(TestResult.java:109)
00:48:23     INFO -  	at junit.framework.TestCase.run(TestCase.java:118)
00:48:23     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
00:48:23     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
00:48:23     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529)
00:48:23     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448)
00:48:23     INFO -  40 INFO TEST-UNEXPECTED-FAIL | testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: View with id: '2131296487' is not found!
00:48:23     INFO -  41 INFO TEST-END | testClearPrivateData | finished in 159889ms
Not actively working on this.
Assignee: michael.l.comella → nobody
Status: ASSIGNED → NEW
I think I may have found the root of this problem as well as why some of my other robocop tests aren't working.

In `BaseTest.selectMenuItem` we open the menu with `mActions.sendSpecialKey(Actions.SpecialKey.MENU)`. On the Android 4.0+ this doesn't seem to work well. The alternative that seems to work, is using `Solo.clickOnMenuItem` which opens the menu for us and then clicks on the item in the list.

Will try and grab this later.
Assignee: nobody → jalmeida
Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella
Attachment #8637050 - Flags: review?(michael.l.comella)
(In reply to Jonathan Almeida [:jonalmeida] from comment #24)
> https://treeherder.mozilla.org/#/jobs?repo=try&revision=2a8f2c062f0a

Btw, when fixing an intermittent and you're not confident you have the fix, it can be good idea to retrigger the suites a few times over, just to check the error doesn't occur again.
Comment on attachment 8637050 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/13787/#review12559

::: build/mobile/robocop/FennecNativeActions.java:370
(Diff revision 1)
> -        mInstr.sendCharacterSync(keyCode);
> +        mSolo.sendKey(keyCode);

According to [the docs](http://robotium.googlecode.com/svn/doc/com/robotium/solo/Solo.html#sendKey%28int%29), this is only supposed to be used with Solo.LEFT/RIGHT/etc.

Do you disagree?
https://reviewboard.mozilla.org/r/13787/#review12559

> According to [the docs](http://robotium.googlecode.com/svn/doc/com/robotium/solo/Solo.html#sendKey%28int%29), this is only supposed to be used with Solo.LEFT/RIGHT/etc.
> 
> Do you disagree?

No, this looks right. In our FennecNativeActions, we only use those directions (with the exception of DELETE which we don't support): http://mxr.mozilla.org/mozilla-central/source/build/mobile/robocop/FennecNativeActions.java#337

Side note: KeyEvent.KEYCODE_DPAD_UP == Solo.UP (i.e. they send the same keycode values).
(In reply to Michael Comella (:mcomella) from comment #26)
> Btw, when fixing an intermittent and you're not confident you have the fix,
> it can be good idea to retrigger the suites a few times over, just to check
> the error doesn't occur again.

Ah, good point. I'm going to run it a couple more times with that that other try message for robocop.
Attachment #8637050 - Attachment is obsolete: true
Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella
Attachment #8647245 - Flags: review?(michael.l.comella)
Realized the previous review got discarded and didn't get feedback about the comments from the last review.
Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/15965/#review14357

::: build/mobile/robocop/FennecNativeActions.java:370
(Diff revision 1)
> -        mInstr.sendCharacterSync(keyCode);
> +        mSolo.sendKey(keyCode);

Under the hood, [robotium uses sendCharacterSync](https://github.com/RobotiumTech/robotium/blob/master/robotium-solo/src/main/java/com/robotium/solo/Sender.java#L43), but notably sleeps before calling it (and catches the exception it may throw).

Why do you think using Solo makes a difference? I'm heisitant because they're documentation suggests we shouldn't supply random key codes - I'd rather just copy their code, just in case they change their code to only support those key codes.
Attachment #8647245 - Flags: review?(michael.l.comella)
https://reviewboard.mozilla.org/r/15965/#review14357

> Under the hood, [robotium uses sendCharacterSync](https://github.com/RobotiumTech/robotium/blob/master/robotium-solo/src/main/java/com/robotium/solo/Sender.java#L43), but notably sleeps before calling it (and catches the exception it may throw).
> 
> Why do you think using Solo makes a difference? I'm heisitant because they're documentation suggests we shouldn't supply random key codes - I'd rather just copy their code, just in case they change their code to only support those key codes.

> Why do you think using Solo makes a difference?

From local testing and a few re-runs of tests on try, I've seen fewer test failures where buttons are not found. There isn't hard evidence for it, but I don't think there is any disadvantage to using Solo's wrapper around sending the key events. For now, it only includes a short sleep before clicking, but it's a wee bit less overhead off of us :)

> I'm heisitant because they're documentation suggests we shouldn't supply random key codes

I mentioned this in the previous review (but it seems to have gone missing somewhere) that we limit the key codes we send to the same filtered ones (D pad keys) that [robotium sends][1]. See [here][2].

We definitely can add the sleep and try-catch to our sendKey() method instead I guess.. ¯\_(ツ)_/¯

[1]: https://github.com/RobotiumTech/robotium/blob/79952a5d88c15c2cc4907a1b9945f340e37d2647/robotium-solo/src/main/java/com/robotium/solo/Solo.java#L79
[2]: https://dxr.mozilla.org/mozilla-central/source/build/mobile/robocop/FennecNativeActions.java#337
Need info so this doesn't get lost again.
Flags: needinfo?(michael.l.comella)
(In reply to Jonathan Almeida (:jonalmeida) from comment #34)
> > I'm heisitant because they're documentation suggests we shouldn't supply random key codes
> 
> I mentioned this in the previous review (but it seems to have gone missing
> somewhere) that we limit the key codes we send to the same filtered ones (D
> pad keys) that [robotium sends][1]. See [here][2].

Fair enough. If you update those key code references to the Solo values (e.g. Solo.RIGHT, or whatever), then I agree with moving to Solo.
Flags: needinfo?(michael.l.comella)
Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella
Attachment #8647245 - Flags: review?(michael.l.comella)
Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

See comment 36.
Attachment #8647245 - Flags: review?(michael.l.comella) → review-
Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella
Attachment #8647245 - Flags: review- → review?(michael.l.comella)
Comment on attachment 8647245 [details]
MozReview Request: Bug 948591 - Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found! r?mcomella

https://reviewboard.mozilla.org/r/15965/#review14611

Thanks.
Attachment #8647245 - Flags: review?(michael.l.comella) → review+
Comment on attachment 8649791 [details] [diff] [review]
Intermittent testClearPrivateData | Exception caught - junit.framework.AssertionFailedError: Text string: '^Settings$' is not found!

Removed 'cause added by mistake from git bz.
Attachment #8649791 - Attachment is obsolete: true
Assignee: jonalmeida942 → nobody
This test has been deleted.
Assignee: nobody → gbrown
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → DUPLICATE
Whiteboard: [test disabled][leave open]
Product: Firefox for Android → Firefox for Android Graveyard
You need to log in before you can comment on or make changes to this bug.