1807284 - Intermittent UI test failure - < SettingsSearchTest. undoDeleteSearchEngineTest >

Status: RESOLVED INCOMPLETE

(Firefox for Android :: UI Tests, defect, P3)

Description

[Chris Peterson [:cpeterson]]

From github: https://github.com/mozilla-mobile/fenix/issues/28014.

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297433, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.assertEngineListContains(SettingsSubMenuSearchRobot.kt:372)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.access$assertEngineListContains(SettingsSubMenuSearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot.verifyEngineListContains(SettingsSubMenuSearchRobot.kt:173)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:331)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:326)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openSearchSubMenu(SettingsRobot.kt:146)
at org.mozilla.fenix.ui.SettingsSearchTest.undoDeleteSearchEngineTest(SettingsSearchTest.kt:326)
... 57 trimmed
Caused by: junit.framework.AssertionFailedError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297433, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Build: 11/29 Main

┆Issue is synchronized with this Jira Task

Change performed by the Move to Bugzilla add-on.

Comment 1

[Oana Horvath [:ohorvath]]

Hasn't failed in more than a month. closing it, but can be reopened if the issue appears again.

Comment 2

[Andrei Jolțan [:Andi]]

Flaky 1x on 3/1 Main Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297448, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.assertEngineListContains(SettingsSubMenuSearchRobot.kt:372)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.access$assertEngineListContains(SettingsSubMenuSearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot.verifyEngineListContains(SettingsSubMenuSearchRobot.kt:173)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:361)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:356)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openSearchSubMenu(SettingsRobot.kt:147)
at org.mozilla.fenix.ui.SettingsSearchTest.undoDeleteSearchEngineTest(SettingsSearchTest.kt:356)
... 57 trimmed

Caused by: junit.framework.AssertionFailedError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297448, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Comment 3

[Andrei Jolțan [:Andi]]

Flaky 1x on 3/9 Main Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297450, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.assertEngineListContains(SettingsSubMenuSearchRobot.kt:372)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.access$assertEngineListContains(SettingsSubMenuSearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot.verifyEngineListContains(SettingsSubMenuSearchRobot.kt:173)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:361)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:356)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openSearchSubMenu(SettingsRobot.kt:142)
at org.mozilla.fenix.ui.SettingsSearchTest.undoDeleteSearchEngineTest(SettingsSearchTest.kt:356)
... 57 trimmed

Caused by: junit.framework.AssertionFailedError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297450, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Comment 4

[Andrei Jolțan [:Andi]]

Flaky 1x on 4/6 Main Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297457, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.assertEngineListContains(SettingsSubMenuSearchRobot.kt:372)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobotKt.access$assertEngineListContains(SettingsSubMenuSearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuSearchRobot.verifyEngineListContains(SettingsSubMenuSearchRobot.kt:173)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:370)
at org.mozilla.fenix.ui.SettingsSearchTest$undoDeleteSearchEngineTest$4.invoke(SettingsSearchTest.kt:365)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openSearchSubMenu(SettingsRobot.kt:232)
at org.mozilla.fenix.ui.SettingsSearchTest.undoDeleteSearchEngineTest(SettingsSearchTest.kt:365)
... 57 trimmed

Caused by: junit.framework.AssertionFailedError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297457, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Comment 5

[Oana Horvath [:ohorvath]]

Flaky on 5/16: https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/5874778053294531238/executions/bs.660a52a15ad1bad/testcases/2/test-cases

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: '(view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")' doesn't match the selected view.
Expected: (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing")
Got: no descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Bing" was found
View Details: RadioGroup{id=2131297506, res-name=search_engine_group, visibility=VISIBLE, width=1080, height=651, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=5}

Comment 6

[Andrei Jolțan [:Andi]]

Attachment: ► 5/31 Main - undoDeleteSearchEngineTest

► 5/31 Main - undoDeleteSearchEngineTest Firebase link

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.