Closed Bug 1808880 Opened 2 years ago Closed 2 years ago

Intermittent UI test failure - < CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest >

Categories

(Firefox for Android :: UI Tests, defect, P3)

Product:
Firefox for Android
Component:
UI Tests
Version:
Firefox 110
Platform:
All
Android
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE
Tracking Flags:
Tracking Status
firefox110 --- fixed
firefox111 --- wontfix
firefox112 --- wontfix
firefox113 --- unaffected
firefox114 --- wontfix
firefox115 --- wontfix
firefox116 --- unaffected
firefox117 --- wontfix
firefox118 --- wontfix
firefox119 --- wontfix

People

(Reporter: ajoltan, Unassigned)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

[mozilla-mobile/firefox-android] Bug 1808880 - Fix privateBrowsingUseAppWhileTabIsCrashedTest UI test (#2077)
59 bytes, text/x-github-pull-request
Details | Review

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:426)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:78)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:128)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:127)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:931)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:127)

Build: 1/5

Instance on
01/10: Matrix

Today's instance is the non-privateBrowsing variant.

This comment should be ignored, the bellow stack and links are for 1809645

Flaky 1x on 1/9 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:426)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:78)
at org.mozilla.fenix.ui.CrashReportingTest$useAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:97)
at org.mozilla.fenix.ui.CrashReportingTest$useAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:96)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:931)
at org.mozilla.fenix.ui.CrashReportingTest.useAppWhileTabIsCrashedTest(CrashReportingTest.kt:96)

Flaky 1x on 1/12 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:426)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:78)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:128)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:127)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:931)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:127)

Fixed with #28499

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED

Flaky 1x on 2/9 Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:426)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:78)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:129)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:128)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:1023)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:128)

Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Severity: -- → S4
Priority: -- → P3
Version: unspecified → Firefox 110

Flaky 1x on 3/1 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:1062)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:128)

status-firefox110: --- → fixed
status-firefox111: --- → wontfix
status-firefox112: --- → affected

Flaky 1x on 3/2 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: for text= "Test_Page_2"
at androidx.test.uiautomator.UiCollection.getChildByText(UiCollection.java:126)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:215)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:426)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:78)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:130)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:128)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:1065)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:128)

Flaky 1x on 3/7 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:1063)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:128)

Closing, as it didn't fail for a month.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox112: affected → wontfix
status-firefox113: --- → unaffected
status-firefox114: --- → unaffected
Resolution: --- → WORKSFORME

Flaky 1x on 4/13 Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:436)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:79)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:129)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:128)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:1138)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:128)

Status: RESOLVED → REOPENED
status-firefox114: unaffected → affected
Resolution: WORKSFORME → ---

Flaky 1x on 4/27 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:442)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:84)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:133)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:131)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:869)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:131)

Flaky 1x on 4/29 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:864)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:131)

Flaky 1x on 5/3 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CLASS=androidx.recyclerview.widget.RecyclerView]
at androidx.test.uiautomator.UiScrollable.scrollBackward(UiScrollable.java:496)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:544)
at androidx.test.uiautomator.UiScrollable.scrollToBeginning(UiScrollable.java:563)
at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:265)
at androidx.test.uiautomator.UiScrollable.getChildByText(UiScrollable.java:213)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.assertExistingOpenTabs(TabDrawerRobot.kt:442)
at org.mozilla.fenix.ui.robots.TabDrawerRobotKt.access$assertExistingOpenTabs(TabDrawerRobot.kt:1)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.verifyExistingOpenTabs(TabDrawerRobot.kt:84)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:133)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$9.invoke(CrashReportingTest.kt:131)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:869)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:131)

Flaky 1x on 5/13 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertNotNull(Assert.java:713)
at org.junit.Assert.assertNotNull(Assert.java:723)
at org.mozilla.fenix.helpers.ext.WaitNotNullKt.waitNotNull(WaitNotNull.kt:20)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobotKt.openEditURLView(NavigationToolbarRobot.kt:289)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:123)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:120)

status-firefox114: affected → wontfix
status-firefox115: --- → affected

Flaky 1x on 5/16: https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/5874778053294531238/executions/bs.9a9b8cc32779bffc/testcases/1/test-cases

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:913)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:131)

Flaky 1x on 5/16 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:112)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$8.invoke(CrashReportingTest.kt:130)
at org.mozilla.fenix.ui.CrashReportingTest$privateBrowsingUseAppWhileTabIsCrashedTest$8.invoke(CrashReportingTest.kt:129)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.openTabCrashReporter(NavigationToolbarRobot.kt:158)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:129)

Performed a status check and the test successfully passed 200x on Firebase.
Will leave it open and see if any problems still occur.

Flaky 1x on 5/23 Main Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:916)
at org.mozilla.fenix.ui.CrashReportingTest.privateBrowsingUseAppWhileTabIsCrashedTest(CrashReportingTest.kt:131)

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox115: affected → wontfix
Resolution: --- → INCOMPLETE

► 7/10 Firebase link

Status: RESOLVED → REOPENED
status-firefox116: --- → unaffected
status-firefox117: --- → affected
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox117: affected → wontfix
Resolution: --- → INCOMPLETE

► 8/9 Firebase link

Status: RESOLVED → REOPENED
status-firefox118: --- → affected
Resolution: INCOMPLETE → ---

► 8/17 Firebase link

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox119: affected → wontfix
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: