1826317 - Intermittent UI test failure - < SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest >

Status: RESOLVED INCOMPLETE

(Firefox for Android :: UI Tests, defect, P3)

Description

[Andrei Jolțan [:Andi]]

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297187, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot.verifyUrl(NavigationToolbarRobot.kt:48)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:79)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:78)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openNavigationToolbar(BrowserRobot.kt:1081)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest(SettingsHTTPSOnlyModeTest.kt:78)
... 32 trimmed

Caused by: junit.framework.AssertionFailedError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297187, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Build: 4/3 Main

Comment 1

[Andrei Jolțan [:Andi]]

Flaky 1x on 4/27 Main Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297190, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot.verifyUrl(NavigationToolbarRobot.kt:48)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:81)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:80)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openNavigationToolbar(BrowserRobot.kt:833)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest(SettingsHTTPSOnlyModeTest.kt:80)
... 32 trimmed

Caused by: junit.framework.AssertionFailedError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297190, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Comment 2

[Andrei Jolțan [:Andi]]

Flaky 1x on 5/2 Main Firebase link

androidx.test.espresso.base.AssertionErrorHandler$AssertionFailedWithCauseError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297190, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:3)
at androidx.test.espresso.base.AssertionErrorHandler.handleSafely(AssertionErrorHandler.java:1)
at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:4)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:5)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot.verifyUrl(NavigationToolbarRobot.kt:48)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:82)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:81)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openNavigationToolbar(BrowserRobot.kt:833)
at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest(SettingsHTTPSOnlyModeTest.kt:81)
... 32 trimmed

Caused by: junit.framework.AssertionFailedError: 'an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"' doesn't match the selected view.
Expected: an instance of android.widget.TextView and view.getText() with or without transformation to match: is "https://example.com/"
Got: view.getText() was "http://example.com/" transformed text was "http://example.com/"
View Details: TextView{id=2131297190, res-name=mozac_browser_toolbar_url_view, visibility=VISIBLE, width=933, height=105, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=true, is-enabled=true, is-focused=false, is-focusable=true, is-layout-requested=false, is-selected=false, layout-params=android.widget.LinearLayout$LayoutParams@YYYYYY, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=http://example.com/, input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:7)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:14)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 4

[Andrei Jolțan [:Andi]]

► 9/3 Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:115)

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 6

[Andrei Jolțan [:Andi]]

► 2/15 Firebase link

java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Example Domain] does not exist at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:99) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:117)

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 8

[Andrei Jolțan [:Andi]]

► 1/28 autoland Firebase link

Comment 9

[Andrei Jolțan [:Andi]]

► 2/3 autoland Firebase link

Comment 10

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 11

[Andrei Jolțan [:Andi]]

► 2/27 autoland Firebase link

Comment 12

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 13

[Delia Pop (Android QA)]

► 7/18 mozilla-release
httpsOnlyModeEnabledInNormalBrowsingTest Firebase link

► 7/18 mozilla-release failure
httpsOnlyModeEnabledInNormalBrowsingTest Firebase link

► 7/18 autoland Firebase link

Comment 14

[Delia Pop (Android QA)]

► 7/22 mozilla-release
Firebase link

Comment 15

[Delia Pop (Android QA)]

► 8/11 autoland Firebase link

► 8/11 autoland Firebase link

Comment 16

[Delia Pop (Android QA)]

► 9/02 mozilla-beta Firebase link

Comment 17

[Delia Pop (Android QA)]

► 9/02 mozilla-beta Firebase link

Comment 18

[Delia Pop (Android QA)]

► 9/04 autoland Firebase link

Comment 19

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.