Closed Bug 1006242 Opened 10 years ago Closed 8 years ago

Intermittent testMasterPassword | Doorhanger notification is hidden - got true, expected false

Categories

(Firefox for Android Graveyard :: General, defect)

Product:
Firefox for Android Graveyard
Component:
General
Platform:
All
Android
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1216257

People

(Reporter: KWierso, Assigned: gbrown)

Details

(Keywords: intermittent-failure) 

https://tbpl.mozilla.org/php/getParsedLog.php?id=39081187&tree=Mozilla-Inbound
Android 4.0 Panda mozilla-inbound opt test robocop-3 on 2014-05-05 15:18:33 PDT for push 46d57b8f48ce

slave: panda-0382



15:36:39     INFO -  0 INFO SimpleTest START
15:36:39     INFO -  1 INFO TEST-START | testMasterPassword
15:36:39     INFO -  2 INFO TEST-PASS | testMasterPassword | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready
15:36:39     INFO -  EventExpecter: no longer listening for Gecko:Ready
15:36:39     INFO -  3 INFO TEST-PASS | testMasterPassword | Waiting for and scrolling once to find item ^Privacy$ - ^Privacy$ found
15:36:39     INFO -  4 INFO TEST-PASS | testMasterPassword | Waiting for enabled text ^Privacy$ - ^Privacy$ option is present and enabled
15:36:39     INFO -  5 INFO TEST-PASS | testMasterPassword | Waiting for and scrolling once to find item ^Use master password$ - ^Use master password$ found
15:36:39     INFO -  6 INFO TEST-PASS | testMasterPassword | Waiting for enabled text ^Use master password$ - ^Use master password$ option is present and enabled
15:36:39     INFO -  7 INFO TEST-PASS | testMasterPassword | Verify if the OK button is inactive - The OK button is inactive until both fields are filled
15:36:39     INFO -  8 INFO TEST-PASS | testMasterPassword | Verify if the OK button is inactive - The OK button is inactive until the Confirm password field is filled
15:36:39     INFO -  9 INFO TEST-PASS | testMasterPassword | Verify if the OK button is inactive - The OK button is inactive until both fields contain the same password
15:36:39     INFO -  10 INFO TEST-PASS | testMasterPassword | Verify if the OK button is inactive - The OK button is inactive until the Password field is filled
15:36:39     INFO -  11 INFO TEST-PASS | testMasterPassword | Checking if no password was set if the action was canceled - No password was set
15:36:39     INFO -  12 INFO TEST-PASS | testMasterPassword | waiting to convert the letters in dots - The letters are converted in dots
15:36:39     INFO -  13 INFO TEST-PASS | testMasterPassword | Checking if Use master password is present - Use master password is present
15:36:39     INFO -  14 INFO TEST-PASS | testMasterPassword | Checking if the password is enabled - The password is enabled
15:36:39     INFO -  15 INFO TEST-PASS | testMasterPassword | waiting for urlbar text to gain focus - urlbar text gained focus
15:36:39     INFO -  16 INFO TEST-PASS | testMasterPassword | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_login.html should equal http://mochi.test:8888/tests/robocop/robocop_login.html
15:36:39     INFO -  17 INFO TEST-PASS | testMasterPassword | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
15:36:39     INFO -  EventExpecter: no longer listening for DOMContentLoaded
15:36:39     INFO -  18 INFO TEST-PASS | testMasterPassword | Doorhanger notification is displayed - true should equal true
15:36:39     INFO -  19 INFO TEST-PASS | testMasterPassword | Checking if Save option is present - Save option is present
15:36:39     INFO -  20 INFO TEST-PASS | testMasterPassword | waiting for urlbar text to gain focus - urlbar text gained focus
15:36:39     INFO -  21 INFO TEST-PASS | testMasterPassword | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_login.html should equal http://mochi.test:8888/tests/robocop/robocop_login.html
15:36:39     INFO -  22 INFO TEST-PASS | testMasterPassword | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded
15:36:39     INFO -  EventExpecter: no longer listening for DOMContentLoaded
15:36:39     INFO -  23 INFO TEST-UNEXPECTED-FAIL | testMasterPassword | Doorhanger notification is hidden - got true, expected false
15:36:39     INFO -  Exception caught during test!
15:36:39     INFO -  junit.framework.AssertionFailedError: 23 INFO TEST-UNEXPECTED-FAIL | testMasterPassword | Doorhanger notification is hidden - got true, expected false
15:36:39     INFO -  	at junit.framework.Assert.fail(Assert.java:47)
15:36:39     INFO -  	at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:111)
15:36:39     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:140)
15:36:39     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.is(FennecMochitestAssert.java:146)
15:36:39     INFO -  	at org.mozilla.gecko.tests.testMasterPassword.noDoorhangerDisplayed(testMasterPassword.java:122)
15:36:39     INFO -  	at org.mozilla.gecko.tests.testMasterPassword.verifyLoginPage(testMasterPassword.java:211)
15:36:39     INFO -  	at org.mozilla.gecko.tests.testMasterPassword.testMasterPassword(testMasterPassword.java:18)
15:36:39     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
15:36:39     INFO -  	at java.lang.reflect.Method.invoke(Method.java:511)
15:36:39     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
15:36:39     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
15:36:39     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
15:36:39     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:125)
15:36:39     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:127)
15:36:39     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:106)
15:36:39     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:124)
15:36:39     INFO -  	at junit.framework.TestResult.run(TestResult.java:109)
15:36:39     INFO -  	at junit.framework.TestCase.run(TestCase.java:118)
15:36:39     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
15:36:39     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
15:36:39     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:545)
15:36:39     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)
15:36:39     INFO -  24 INFO TEST-UNEXPECTED-FAIL | testMasterPassword | Exception caught - junit.framework.AssertionFailedError: 23 INFO TEST-UNEXPECTED-FAIL | testMasterPassword | Doorhanger notification is hidden - got true, expected false
15:36:39     INFO -  25 INFO TEST-END | testMasterPassword | finished in 80693ms
15:36:39     INFO -  26 INFO TEST-START | Shutdown
Brian, can you please take a look at this failure which started happening yesterday with high frequency?
Flags: needinfo?(bnicholson)
I can take a look today, but I'll be on PTO for the rest of the week starting tomorrow, so I might have to dump this on someone else.
Flags: needinfo?(bnicholson)
I haven't had any luck reproducing this today, so maybe someone else can take a look. I think Margaret worked on door hangers and Wes worked on master password -- could either of you take a look at this?

Note that this failure started appearing with this push: https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=1b8d0fcafd1f. Not sure how it's related.
Flags: needinfo?(wjohnston)
Flags: needinfo?(margaret.leibovic)
This intermittent failure is #4 on OrangeFactor, and as such worthy of escalation due to https://wiki.mozilla.org/Sheriffing/Test_Disabling_Policy

Needinfo'ing an appropriate person for estimation of next steps & timeframe. The policy requires that I state that after two working days a needinfo on the module owner will be added (if they aren't already), and failing that - the test disabled (or suite hidden if disabling isn't an option) 2 working days after that. But that's an absolutely last resort :-)

Margaret or Wes, do one of you have a chance to look at this soon? :)
Actually, this is happening frequently enough (>30%) that we can disable the test ASAP.
https://hg.mozilla.org/integration/fx-team/rev/e85bfba14a5b

Also, FWIW, retriggers on inbound appear to be pointing at the Seer disabling (bug 1005958) as what made this so failure-happy. Not entirely sure what the meaning of that is :)
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&fromchange=b4c8f40b1ef6&tochange=1b8d0fcafd1f&jobname=Android%204.0%20Panda%20mozilla-inbound%20opt%20test%20robocop-3
Whiteboard: [test disabled on Android 4.0][leave open]
I'm honestly not sure why disabling the seer would cause the bug, either, especially given that lots of retriggers when the same patch landed on release were all green: https://tbpl.mozilla.org/?tree=Mozilla-Release&rev=bebd4af02d88 (:KWierso and I both kept a close eye on that landing, given the odd oranges on inbound).

In fact, none of the failures appear on any tree that's not m-c or one of the integration branches (unless I missed something, quite possible with all the tbpl bot comments to scroll through). I suppose one or all of the failures on try could be from non-m-c try runs, but that somehow seems unlikely. Have there been significant changes to this test since 29 was released?

Let me just put it this way, though. If anything to do with master password/doorhanger is at all contingent on the seer being enabled, then I suspect something has gone horribly, horribly wrong there :)
testMasterPassword doesn't exactly have a sterling reputation for stability (there are other bugs on file for intermittent failures in it), so I wouldn't be surprised if that were the case :)
Flags: needinfo?(wjohnston)
Flags: needinfo?(margaret.leibovic)
This test has been deleted.
Assignee: nobody → gbrown
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → DUPLICATE
Whiteboard: [test disabled on Android 4.0][leave open]
Product: Firefox for Android → Firefox for Android Graveyard
You need to log in before you can comment on or make changes to this bug.