1894605 - Intermittent UI test failure - < SettingsAboutTest. verifyAboutFirefoxMenuItems >

Status: RESOLVED INCOMPLETE

(Firefox for Android :: UI Tests, defect, P3)

Description

[Andrei Jolțan [:Andi]]

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: (view.getId() is <2131297181/org.mozilla.fenix.debug:id/menuButton>)

View Hierarchy:
+>PopupLayout{id=16908290, res-name=content, visibility=VISIBLE, width=906, height=241, has-focus=true, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params={(81,1443)(906x241) gr=TOP START CENTER ty=APPLICATION_SUB_PANEL fmt=TRANSLUCENT
fl=WATCH_OUTSIDE_TOUCH HARDWARE_ACCELERATED
fitTypes=STATUS_BARS NAVIGATION_BARS CAPTION_BAR}, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=1}
|
+->AndroidComposeView{id=-1, visibility=VISIBLE, width=906, height=241, has-focus=true, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=true, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.view.ViewGroup$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=1}
|
+-->AndroidViewsHandler{id=-1, visibility=VISIBLE, width=906, height=241, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.view.ViewGroup$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=0}
The complete view hierarchy is available in artifact file 'view-hierarchy-3.txt'.
at androidx.test.espresso.NoMatchingViewException$Builder.build(NoMatchingViewException.java:5)
at androidx.test.espresso.base.DefaultFailureHandler.lambda$getNoMatchingViewExceptionTruncater$0(DefaultFailureHandler.java:5)
at androidx.test.espresso.base.DefaultFailureHandler$$ExternalSyntheticLambda1.truncateExceptionMessage(Unknown Source:2)
at androidx.test.espresso.base.ViewHierarchyExceptionHandler.handleSafely(ViewHierarchyExceptionHandler.java:5)
at androidx.test.espresso.base.ViewHierarchyExceptionHandler.handleSafely(ViewHierarchyExceptionHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:8)
at androidx.test.espresso.ViewInteraction.desugaredPerform(ViewInteraction.java:11)
at androidx.test.espresso.ViewInteraction.perform(ViewInteraction.java:8)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openThreeDotMenu(HomeScreenRobot.kt:692)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxMenuItems(SettingsAboutTest.kt:69)

Build: 5/2 Main

Comment 1

[Andrei Jolțan [:Andi]]

► 5/9 Firebase link

► Failed 1x 5/10
Firebase link
Firebase link

Comment 2

[Andrei Jolțan [:Andi]]

Attachment: Bug 1894605 - Fix verifyAboutFirefoxMenuItems UI test

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4ba719fe2467
Fix verifyAboutFirefoxMenuItems UI test r=ohorvath

Comment 4

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/4ba719fe2467

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:ajoltan, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox127 to wontfix.

For more information, please visit BugBot documentation.

Comment 6

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-beta/rev/e7bd451e798a

Comment 7

[Andrei Jolțan [:Andi]]

► 5/29 Firebase link

java.lang.AssertionError at org.junit.Assert.fail(Assert.java:87) at org.junit.Assert.assertTrue(Assert.java:42) at org.junit.Assert.assertNotNull(Assert.java:713) at org.junit.Assert.assertNotNull(Assert.java:723) at org.mozilla.fenix.helpers.ext.WaitNotNullKt.waitNotNull(WaitNotNull.kt:24) at org.mozilla.fenix.helpers.TestHelper.waitUntilObjectIsFound(TestHelper.kt:111) at org.mozilla.fenix.helpers.TestHelper.verifyUrl(TestHelper.kt:149) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifySupport(SettingsSubMenuAboutRobot.kt:131) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyTheLinksList(SettingsSubMenuAboutRobot.kt:238) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreviewInfo(SettingsSubMenuAboutRobot.kt:55)

Comment 8

[Andrei Jolțan [:Andi]]

► 6/1 Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries")' doesn't match the selected view. Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries") Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries" was found View Details: Toolbar{id=2131297293, res-name=navigationToolbar, visibility=VISIBLE, width=1080, height=147, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=4} at dalvik.system.VMStack.getThreadStackTrace(Native Method) at java.lang.Thread.getStackTrace(Thread.java:1736) at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3) at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1) at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4) at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5) at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5) at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyLibrariesUsedLink(SettingsSubMenuAboutRobot.kt:219)

► 6/5 Firebase link

java.lang.AssertionError: UiSelector[CONTAINS_TEXT=support.mozilla.org/1/mobile/1.0.2423/Android/en-US/faq-android, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] does not exist at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:103) at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:85) at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:384) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:85) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyHelpUrl(BrowserRobot.kt:117) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot$verifySupportLink$1.invoke(SettingsSubMenuAboutRobot.kt:132) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot$verifySupportLink$1.invoke(SettingsSubMenuAboutRobot.kt:131) at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1348) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifySupportLink(SettingsSubMenuAboutRobot.kt:131) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyTheLinksList(SettingsSubMenuAboutRobot.kt:230) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreviewInfo(SettingsSubMenuAboutRobot.kt:55) at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxMenuItems$4.invoke(SettingsAboutTest.kt:68) at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxMenuItems$4.invoke(SettingsAboutTest.kt:67) at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:509) at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxMenuItems(SettingsAboutTest.kt:67)

Comment 9

[Andrei Jolțan [:Andi]]

► 6/18 Firebase link

java.lang.AssertionError: UiSelector[CONTAINS_TEXT=/privacy/firefox, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] does not exist at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:103) at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:85) at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:384) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:85) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot$verifyPrivacyNoticeLink$1.invoke(SettingsSubMenuAboutRobot.kt:172) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot$verifyPrivacyNoticeLink$1.invoke(SettingsSubMenuAboutRobot.kt:171) at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1348) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyPrivacyNoticeLink(SettingsSubMenuAboutRobot.kt:171) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyTheLinksList(SettingsSubMenuAboutRobot.kt:233) at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreviewInfo(SettingsSubMenuAboutRobot.kt:55) at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxMenuItems$4.invoke(SettingsAboutTest.kt:68) at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxMenuItems$4.invoke(SettingsAboutTest.kt:67) at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:509) at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxMenuItems(SettingsAboutTest.kt:67)

Comment 10

[Andrei Jolțan [:Andi]]

► 6/25 mozilla-beta Firebase link

Comment 11

[Andrei Jolțan [:Andi]]

► 6/26 mozilla-central Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries")' doesn't match the selected view. Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries") Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: a string containing "Firefox Fenix | OSS Libraries" was found View Details: Toolbar{id=2131297296, res-name=navigationToolbar, visibility=VISIBLE, width=1080, height=147, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=4} at dalvik.system.VMStack.getThreadStackTrace(Native Method))

Comment 12

[Andrei Jolțan [:Andi]]

► 7/2 Autoland Firebase link

► 7/9 Autoland Firebase link

► 7/11 mozilla-beta Firebase link

► 7/22 Autoland Firebase link

► 7/25 mozilla-beta Firebase link

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 14

[Andrei Jolțan [:Andi]]

►8/9 mozilla-beta Firebase link

Comment 15

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.