Open Bug 1829104 Opened 2 years ago Updated 6 days ago

Intermittent UI test failure - < NavigationToolbarTest.verifyInsecurePageSecuritySubMenuTest >

Categories

(Firefox for Android :: UI Tests, defect, P3)

Product:
Firefox for Android
Component:
UI Tests
Version:
Firefox 114
Platform:
All
Android
Type:
defect

Tracking

()

Status:
REOPENED
Milestone:
115 Branch
Tracking Flags:
Tracking Status
firefox114 --- disabled
firefox115 --- fixed
firefox116 --- unaffected
firefox117 --- unaffected
firefox118 --- wontfix
firefox142 --- unaffected
firefox143 --- unaffected
firefox144 --- wontfix
firefox145 --- unaffected
firefox146 --- affected
firefox147 --- unaffected

People

(Reporter: ajoltan, Assigned: ajoltan)

Details

(Keywords: intermittent-failure)

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.assertSecureConnectionSubMenu(SiteSecurityRobot.kt:49)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.access$assertSecureConnectionSubMenu(SiteSecurityRobot.kt:1)
at org.mozilla.fenix.ui.robots.SiteSecurityRobot.verifySecureConnectionSubMenu(SiteSecurityRobot.kt:32)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:243)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:240)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openSiteSecuritySheet(BrowserRobot.kt:1342)
at org.mozilla.fenix.ui.NavigationToolbarTest.verifyInsecurePageSecuritySubMenuTest(NavigationToolbarTest.kt:240)

Build: 4/19 Main

Flaky 1x on 4/25 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.assertSecureConnectionSubMenu(SiteSecurityRobot.kt:49)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.access$assertSecureConnectionSubMenu(SiteSecurityRobot.kt:1)
at org.mozilla.fenix.ui.robots.SiteSecurityRobot.verifySecureConnectionSubMenu(SiteSecurityRobot.kt:32)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:245)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:242)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openSiteSecuritySheet(BrowserRobot.kt:989)
at org.mozilla.fenix.ui.NavigationToolbarTest.verifyInsecurePageSecuritySubMenuTest(NavigationToolbarTest.kt:242)

Failed 1x on 4/27 Main
Firebase link
Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.assertSecureConnectionSubMenu(SiteSecurityRobot.kt:49)
at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.access$assertSecureConnectionSubMenu(SiteSecurityRobot.kt:1)
at org.mozilla.fenix.ui.robots.SiteSecurityRobot.verifySecureConnectionSubMenu(SiteSecurityRobot.kt:32)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:245)
at org.mozilla.fenix.ui.NavigationToolbarTest$verifyInsecurePageSecuritySubMenuTest$3.invoke(NavigationToolbarTest.kt:242)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openSiteSecuritySheet(BrowserRobot.kt:1001)
at org.mozilla.fenix.ui.NavigationToolbarTest.verifyInsecurePageSecuritySubMenuTest(NavigationToolbarTest.kt:242)

Authored by https://github.com/AndiAJ
https://github.com/mozilla-mobile/firefox-android/commit/39abfce2f684ea2630f2e2f1c279bd016123b78c
[main] Bug 1829104 - Disable failing verifyInsecurePageSecuritySubMenuTest UI test

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox114: affected → fixed
Flags: qe-verify+
Resolution: --- → FIXED
Target Milestone: --- → 114 Branch
Status: RESOLVED → REOPENED
Flags: qe-verify+
Keywords: test-disabled
Resolution: FIXED → ---
Assignee: nobody → andrei.joltan

Authored by https://github.com/AndiAJ
https://github.com/mozilla-mobile/firefox-android/commit/8dc9f859a4f75050c2d5f6b020a54963211aadcf
[main] Bug 1829104 - Re-enable verifyInsecurePageSecuritySubMenuTest UI test

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox115: --- → fixed
Flags: qe-verify+
Resolution: --- → FIXED
Target Milestone: 114 Branch → 115 Branch
Flags: qe-verify+

► 8/4 Firebase link

java.lang.AssertionError at org.junit.Assert.fail(Assert.java:87) at org.junit.Assert.assertTrue(Assert.java:42) at org.junit.Assert.assertTrue(Assert.java:53) at org.mozilla.fenix.ui.robots.SiteSecurityRobotKt.assertSecureConnectionSubMenu(SiteSecurityRobot.kt:52)

Status: RESOLVED → REOPENED
status-firefox116: --- → unaffected
status-firefox117: --- → unaffected
status-firefox118: --- → affected
Keywords: test-disabled
Resolution: FIXED → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox118: affected → wontfix
Resolution: --- → INCOMPLETE

► 9/11 mozilla-central Firebase link

Status: RESOLVED → REOPENED
status-firefox142: --- → unaffected
status-firefox143: --- → unaffected
status-firefox144: --- → affected
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 1 month ago
status-firefox144: affected → wontfix
Resolution: --- → INCOMPLETE

► 11/07 mozilla-beta Firebase link

Status: RESOLVED → REOPENED
status-firefox145: --- → unaffected
status-firefox146: --- → affected
status-firefox147: --- → unaffected
Resolution: INCOMPLETE → ---
You need to log in before you can comment on or make changes to this bug.