1461024 - Intermittent testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available

Status: RESOLVED INCOMPLETE

(Firefox for Android Graveyard :: Testing, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=178093797&repo=autoland

https://queue.taskcluster.net/v1/task/XYmKiVk4TOuoZoQ-ro0lJA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-05-11T21:27:39.470Z] 21:27:39  WARNING -  TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-05-11T21:27:49.782Z] 21:27:49     INFO -  0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-05-11T21:27:49.782Z] 21:27:49     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
[task 2018-05-11T21:27:49.782Z] 21:27:49     INFO -  	at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:124)
[task 2018-05-11T21:27:49.783Z] 21:27:49     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:145)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at org.mozilla.gecko.tests.ContentContextMenuTest.verifyContextMenuItems(ContentContextMenuTest.java:43)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at org.mozilla.gecko.tests.testPrivateBrowsing.testPrivateBrowsing(testPrivateBrowsing.java:42)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at java.lang.reflect.Method.invoke(Method.java:525)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at org.mozilla.gecko.tests.BaseRobocopTest.runTest(BaseRobocopTest.java:188)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
[task 2018-05-11T21:27:49.789Z] 21:27:49     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at org.mozilla.gecko.FennecInstrumentationTestRunner.onStart(FennecInstrumentationTestRunner.java:64)
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
[task 2018-05-11T21:27:49.790Z] 21:27:49  WARNING -  TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-05-11T21:27:49.790Z] 21:27:49     INFO -  TEST-OK | testPrivateBrowsing | took 85008ms

Comment 1

[Intermittent Failures Robot]

2 failures in 660 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* osx-10-10: 1
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 2

[Intermittent Failures Robot]

1 failures in 639 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 3

[Intermittent Failures Robot]

1 failures in 655 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 4

[Intermittent Failures Robot]

1 failures in 408 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-06-11&endday=2018-06-17&tree=trunk

Comment 5

[Intermittent Failures Robot]

1 failures in 521 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-06-18&endday=2018-06-24&tree=trunk

Comment 6

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 7

[Andreea Pavel [:apavel]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=189436460&repo=mozilla-central&lineNumber=1522

task 2018-07-22T22:41:59.041Z] 22:41:59     INFO -  TEST-START | testPrefsObserver
[task 2018-07-22T22:42:19.679Z] 22:42:19     INFO -  GECKO | EventExpecter: no longer listening for Gecko:Ready
[task 2018-07-22T22:42:30.002Z] 22:42:30     INFO -  GECKO | EventExpecter: no longer listening for Gecko:Ready
[task 2018-07-22T22:42:30.003Z] 22:42:30     INFO -  TEST-OK | testPrefsObserver | took 35683ms
[task 2018-07-22T22:42:30.005Z] 22:42:30     INFO -  TEST-START | Shutdown
[task 2018-07-22T22:42:30.006Z] 22:42:30     INFO -  Passed: 19
[task 2018-07-22T22:42:30.007Z] 22:42:30     INFO -  Failed: 0
[task 2018-07-22T22:42:30.007Z] 22:42:30     INFO -  Todo: 0
[task 2018-07-22T22:42:30.007Z] 22:42:30     INFO -  SimpleTest FINISHED
[task 2018-07-22T22:42:51.053Z] 22:42:51     INFO -  INFO | automation.py | Application ran for: 0:01:05.257331
[task 2018-07-22T22:42:51.053Z] 22:42:51     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpNKGvUQpidlog
[task 2018-07-22T22:42:51.678Z] 22:42:51     INFO -  /data/tombstones does not exist; tombstone check skipped
[task 2018-07-22T22:42:55.768Z] 22:42:55     INFO -  INFO | automation.py | Application pid: 3029
[task 2018-07-22T22:43:07.003Z] 22:43:07     INFO -  SimpleTest START
[task 2018-07-22T22:43:07.003Z] 22:43:07     INFO -  TEST-START | testPrivateBrowsing
[task 2018-07-22T22:43:28.550Z] 22:43:28     INFO -  GECKO | EventExpecter: no longer listening for Gecko:Ready
[task 2018-07-22T22:43:38.874Z] 22:43:38     INFO -  GECKO | EventExpecter: no longer listening for Tab:Added
[task 2018-07-22T22:43:49.189Z] 22:43:49     INFO -  GECKO | EventExpecter: no longer listening for Content:PageShow
[task 2018-07-22T22:44:30.869Z] 22:44:30     INFO -  Buffered messages logged at 22:43:06
[task 2018-07-22T22:44:30.869Z] 22:44:30     INFO -  TEST-PASS | testPrivateBrowsing | Robocop tests need the test device screen to be powered on. -
[task 2018-07-22T22:44:30.871Z] 22:44:30     INFO -  Buffered messages logged at 22:43:28
[task 2018-07-22T22:44:30.871Z] 22:44:30     INFO -  TEST-PASS | testPrivateBrowsing | Given message occurred for registered event: {type=null} - Gecko:Ready should equal Gecko:Ready
[task 2018-07-22T22:44:30.871Z] 22:44:30     INFO -  Buffered messages logged at 22:43:32
[task 2018-07-22T22:44:30.871Z] 22:44:30     INFO -  TEST-PASS | testPrivateBrowsing | Given message occurred for registered event: {external=false, tabIndex=-1, isPrivate=false, delayLoad=false, cancelEditMode=false, uri=about:home, stub=true, type=null, tabID=0, title=about:home, parentId=-1, selected=true, desktopMode=false} - Tab:Added should equal Tab:Added
[task 2018-07-22T22:44:30.871Z] 22:44:30     INFO -  Buffered messages logged at 22:43:39
[task 2018-07-22T22:44:30.872Z] 22:44:30     INFO -  TEST-PASS | testPrivateBrowsing | Given message occurred for registered event: {userRequested=, type=null, fromCache=false, tabID=0} - Content:PageShow should equal Content:PageShow
[task 2018-07-22T22:44:30.873Z] 22:44:30     INFO -  TEST-PASS | testPrivateBrowsing | The correct number of tabs are opened - 1 should equal 1
[task 2018-07-22T22:44:30.873Z] 22:44:30     INFO -  Buffered messages logged at 22:43:51
[task 2018-07-22T22:44:30.873Z] 22:44:30     INFO -  long-clicking at 400.0, 222.0
[task 2018-07-22T22:44:30.873Z] 22:44:30     INFO -  Buffered messages logged at 22:44:14
[task 2018-07-22T22:44:30.873Z] 22:44:30     INFO -  waitForText timeout on Open Link in Private Tab
[task 2018-07-22T22:44:30.874Z] 22:44:30     INFO -  Buffered messages finished
[task 2018-07-22T22:44:30.874Z] 22:44:30  WARNING -  TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-07-22T22:44:30.875Z] 22:44:30     INFO -  0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-07-22T22:44:30.875Z] 22:44:30     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
[task 2018-07-22T22:44:30.876Z] 22:44:30     INFO -  	at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:124)
[task 2018-07-22T22:44:30.876Z] 22:44:30     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:145)
[task 2018-07-22T22:44:30.876Z] 22:44:30     INFO -  	at org.mozilla.gecko.tests.ContentContextMenuTest.verifyContextMenuItems(ContentContextMenuTest.java:43)
[task 2018-07-22T22:44:30.877Z] 22:44:30     INFO -  	at org.mozilla.gecko.tests.testPrivateBrowsing.testPrivateBrowsing(testPrivateBrowsing.java:42)
[task 2018-07-22T22:44:30.877Z] 22:44:30     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
[task 2018-07-22T22:44:30.877Z] 22:44:30     INFO -  	at java.lang.reflect.Method.invoke(Method.java:525)
[task 2018-07-22T22:44:30.878Z] 22:44:30     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
[task 2018-07-22T22:44:30.878Z] 22:44:30     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
[task 2018-07-22T22:44:30.878Z] 22:44:30     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
[task 2018-07-22T22:44:30.879Z] 22:44:30     INFO -  	at org.mozilla.gecko.tests.BaseRobocopTest.runTest(BaseRobocopTest.java:186)
[task 2018-07-22T22:44:30.879Z] 22:44:30     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
[task 2018-07-22T22:44:30.879Z] 22:44:30     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
[task 2018-07-22T22:44:30.880Z] 22:44:30     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
[task 2018-07-22T22:44:30.880Z] 22:44:30     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
[task 2018-07-22T22:44:30.880Z] 22:44:30     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
[task 2018-07-22T22:44:30.881Z] 22:44:30     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
[task 2018-07-22T22:44:30.881Z] 22:44:30     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
[task 2018-07-22T22:44:30.881Z] 22:44:30     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
[task 2018-07-22T22:44:30.882Z] 22:44:30     INFO -  	at org.mozilla.gecko.FennecInstrumentationTestRunner.onStart(FennecInstrumentationTestRunner.java:64)
[task 2018-07-22T22:44:30.882Z] 22:44:30     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
[task 2018-07-22T22:44:30.882Z] 22:44:30  WARNING -  TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPrivateBrowsing | Checking that the option: Open Link in Private Tab is available - The option is available
[task 2018-07-22T22:44:30.883Z] 22:44:30     INFO -  TEST-OK | testPrivateBrowsing | took 86611ms
[task 2018-07-22T22:44:30.883Z] 22:44:30     INFO -  TEST-START | Shutdown
[task 2018-07-22T22:44:30.883Z] 22:44:30     INFO -  Passed: 5
[task 2018-07-22T22:44:30.884Z] 22:44:30     INFO -  Failed: 2
[task 2018-07-22T22:44:30.884Z] 22:44:30     INFO -  Todo: 0
[task 2018-07-22T22:44:30.884Z] 22:44:30     INFO -  SimpleTest FINISHED
[task 2018-07-22T22:44:52.028Z] 22:44:52     INFO -  INFO | automation.py | Application ran for: 0:01:58.172714
[task 2018-07-22T22:44:52.028Z] 22:44:52     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpuiiaakpidlog
[task 2018-07-22T22:44:52.654Z] 22:44:52     INFO -  /data/tombstones does not exist; tombstone check skipped
[task 2018-07-22T22:44:54.304Z] 22:44:54     INFO -  07-22 15:43:00.173 E/GeckoSearchEngineManager( 3029): Could not find search plugin files in profile directory
[task 2018-07-22T22:44:54.304Z] 22:44:54     INFO -  07-22 15:43:00.173 E/GeckoSearchEngineManager( 3029): Could not create search engine from name: null
[task 2018-07-22T22:44:54.311Z] 22:44:54     INFO -  07-22 15:43:00.173 D/GeckoSessInfo( 3029): Recording start of session: 1532299379895

Comment 8

[Intermittent Failures Robot]

1 failures in 653 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-07-16&endday=2018-07-22&tree=trunk

Comment 9

[Firefox Bug Husbandry Bot]

Re-triaging per https://bugzilla.mozilla.org/show_bug.cgi?id=1473195

Needinfo :susheel if you think this bug should be re-triaged.

Comment 10

[Intermittent Failures Robot]

1 failures in 760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1461024&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 11

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 12

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup