1830019 - Intermittent UI test failure - < SettingsSearchTest. addPredefinedSearchEngineTest >

Status: RESOLVED INCOMPLETE

(Firefox for Android :: UI Tests, defect, P3)

Description

[Andrei Jolțan [:Andi]]

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError: Assert failed: The component is not displayed!
at androidx.compose.ui.test.AssertionsKt.assertIsDisplayed(Assertions.kt:35)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertEngineListShortcutContains(SearchRobot.kt:521)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertEngineListShortcutContains(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifyEnginesListShortcutContains(SearchRobot.kt:202)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:201)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:198)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:574)
at org.mozilla.fenix.ui.SettingsSearchTest.addPredefinedSearchEngineTest(SettingsSearchTest.kt:198)

Build: 4/25 Main

Comment 1

[Andrei Jolțan [:Andi]]

Flaky 1x on 4/27 Main Firebase link

java.lang.AssertionError: No node found that matches Text + EditableText contains 'Reddit' (ignoreCase: false) in scrollable container
Semantics of the node:
Node #86 at (l=0.0, t=63.0, r=1080.0, b=470.0)px, Tag: 'mozac.awesomebar.suggestions'
VerticalScrollAxisRange = 'ScrollAxisRange(value=0.0, maxValue=0.0, reverseScrolling=false)'
CollectionInfo = 'androidx.compose.ui.semantics.CollectionInfo@35e7e80'
Actions = [IndexForKey, ScrollBy, ScrollToIndex]
Has 3 children
Selector used: (TestTag = 'mozac.awesomebar.suggestions')

at androidx.compose.ui.test.ActionsKt.performScrollToNode(Actions.kt:249)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertEngineListShortcutContains(SearchRobot.kt:518)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertEngineListShortcutContains(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifyEnginesListShortcutContains(SearchRobot.kt:202)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:201)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:198)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:574)
at org.mozilla.fenix.ui.SettingsSearchTest.addPredefinedSearchEngineTest(SettingsSearchTest.kt:198)

Comment 2

[Andrei Jolțan [:Andi]]

Flaky 1x on 5/16 Main Firebase link

java.lang.AssertionError: Failed: performScrollToNode(Text + EditableText contains 'Reddit' (ignoreCase: false))
Reason: Expected exactly '1' node but could not find any node that satisfies: (TestTag = 'mozac.awesomebar.suggestions')

at androidx.compose.ui.test.SemanticsNodeInteraction.fetchOneOrDie(SemanticsNodeInteraction.kt:145)
at androidx.compose.ui.test.SemanticsNodeInteraction.fetchSemanticsNode(SemanticsNodeInteraction.kt:79)
at androidx.compose.ui.test.ActionsKt.performScrollToNode(Actions.kt:217)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertEngineListShortcutContains(SearchRobot.kt:503)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertEngineListShortcutContains(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifyEnginesListShortcutContains(SearchRobot.kt:188)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:201)
at org.mozilla.fenix.ui.SettingsSearchTest$addPredefinedSearchEngineTest$7.invoke(SettingsSearchTest.kt:198)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:575)
at org.mozilla.fenix.ui.SettingsSearchTest.addPredefinedSearchEngineTest(SettingsSearchTest.kt:198)

Comment 3

[Andrei Jolțan [:Andi]]

Attachment: ► 5/26 Main

► 5/26 Main

Comment 4

[Andrei Jolțan [:Andi]]

► Failed 2x on 6/9
Firebase link
Firebase link
Firebase link
Firebase link

Comment 5

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1830019 - Comment keyboard verification step causing failures in UI tests (#2389)

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.