1859489 - Intermittent UI test failure - < SettingsSearchTest. verifyLearnMoreLinksFromAddSearchEngineSectionTest >

Status: RESOLVED FIXED

(Fenix :: UI Tests, defect, P3)

Description

[Andrei Jolțan [:Andi]]

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:82)
at org.mozilla.fenix.ui.SettingsSearchTest$verifyLearnMoreLinksFromAddSearchEngineSectionTest$9.invoke(SettingsSearchTest.kt:286)
at org.mozilla.fenix.ui.SettingsSearchTest$verifyLearnMoreLinksFromAddSearchEngineSectionTest$9.invoke(SettingsSearchTest.kt:285)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot$Transition.clickCustomSearchSuggestionsLearnMoreLink(SettingsSubMenuSearchRobot.kt:385)
at org.mozilla.fenix.ui.SettingsSearchTest.verifyLearnMoreLinksFromAddSearchEngineSectionTest(SettingsSearchTest.kt:285)

Build: 10/16 Main

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 2

[Andrei Jolțan [:Andi]]

► 2/6 Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[INDEX=1, CHILD=UiSelector[RESOURCE_ID=org.mozilla.fenix.debug:id/top_site_title], RESOURCE_ID=org.mozilla.fenix.debug:id/top_site_item] at androidx.test.uiautomator.UiObject.getText(UiObject.java:564) at org.mozilla.fenix.helpers.DataGenerationHelper.getSponsoredShortcutTitle(DataGenerationHelper.kt:89)

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 4

[Oana Horvath [:ohorvath]]

Started failing on 5/29 with '429 Too many requests'
Firebase link
similar issue in Bug 1899659 & Bug 1896363

java.lang.AssertionError: UiSelector[CONTAINS_TEXT=support.mozilla.org/en-US/kb/manage-my-default-search-engines-firefox-android?as=u&utm_source=inproduct, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] does not exist
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100)
at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92)
at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:103)
at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:85)
at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:384)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:85)
at org.mozilla.fenix.ui.SettingsSearchTest$verifyLearnMoreLinksFromAddSearchEngineSectionTest$5.invoke(SettingsSearchTest.kt:274)
at org.mozilla.fenix.ui.SettingsSearchTest$verifyLearnMoreLinksFromAddSearchEngineSectionTest$5.invoke(SettingsSearchTest.kt:273)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot$Transition.clickCustomSearchStringLearnMoreLink(SettingsSubMenuSearchRobot.kt:494)
at org.mozilla.fenix.ui.SettingsSearchTest.verifyLearnMoreLinksFromAddSearchEngineSectionTest(SettingsSearchTest.kt:273)

Comment 5

[Oana Horvath [:ohorvath]]

Attachment: Bug 1859489 - Disable perma failing test verifyLearnMoreLinksFromAddSearchEngineSectionTest

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/656403fa37e3
Disable perma failing test verifyLearnMoreLinksFromAddSearchEngineSectionTest r=aaronmt

Comment 7

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/656403fa37e3

Comment 8

[Oana Horvath [:ohorvath]]

Attachment: Bug 1859489 - Fix tests with redirected SUMO URLs

Try runs are green https://treeherder.mozilla.org/jobs?repo=try&revision=4510b16a78301e98238674590266256d9f7ae11d&selectedTaskRun=FL2e3Cd6S4OcKmt1at8Dww.0

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/55931677182e
Fix tests with redirected SUMO URLs r=ajoltan

Comment 10

[BugBot [:suhaib / :marco/ :calixte]]

A patch has been attached on this bug, which was already closed. Filing a separate bug will ensure better tracking. If this was not by mistake and further action is needed, please alert the appropriate party. (Or: if the patch doesn't change behavior -- e.g. landing a test case, or fixing a typo -- then feel free to disregard this message)

Comment 11

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/55931677182e