1833874 - Intermittent UI test failure - BrowsingErrorPagesTest.connectionFailureErrorMessageTest

Status: RESOLVED FIXED

(Firefox for Android :: UI Tests, defect, P3)

Description

[Oana Horvath [:ohorvath - out of office]]

Failed 2x on 5/18: https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/6550582477811482759/executions/bs.c390d2a05081ab0c/testcases/4/test-cases
Re-checking and will disable it if it continues to be unstable.

Comment 1

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1833874 - control run (#2103)

Comment 2

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1833874 - Disables failing connectionFailureErrorMessageTest (#2105)

Comment 3

[BMO Github Automation]

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/cfe57e7aa35fc25f043c432b5d10a0d047893bc6
[main] Bug 1833874 - Disables failing connectionFailureErrorMessageTest

Comment 4

[Andrei Jolțan [:Andi]]

Failed 2x on 5/18 Main

Firebase link
Firebase link
Firebase link
Firebase link

java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertTrue(Assert.java:53)
at org.mozilla.fenix.helpers.MatcherHelper.assertItemContainingTextExists(MatcherHelper.kt:67)
at org.mozilla.fenix.helpers.MatcherHelper.assertItemContainingTextExists$default(MatcherHelper.kt:64)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyConnectionErrorMessage(BrowserRobot.kt:807)
at org.mozilla.fenix.ui.BrowsingErrorPagesTest$connectionFailureErrorMessageTest$5.invoke(BrowsingErrorPagesTest.kt:105)
at org.mozilla.fenix.ui.BrowsingErrorPagesTest$connectionFailureErrorMessageTest$5.invoke(BrowsingErrorPagesTest.kt:103)
at org.mozilla.fenix.ui.robots.ThreeDotMenuMainRobot$Transition.refreshPage(ThreeDotMenuMainRobot.kt:313)
at org.mozilla.fenix.ui.BrowsingErrorPagesTest.connectionFailureErrorMessageTest(BrowsingErrorPagesTest.kt:103)

Comment 5

[Intermittent Failures Robot]

2 failures in 3578 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• firefox-android: 2

Platform and build breakdown:

• fenix-ui-test: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1833874&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 6

[BMO Github Automation]

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/6e1fab7699c3e4d7bc158a8bdc91d1803ce7bbac
[main] Bug 1833874 - Replace connection error test steps

Comment 7

[BMO Github Automation]

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/2fae54bb07fd2f50cbbea06dd25527f2b30cb5c8
[releases_v114] Bug 1833874 - Disables failing connectionFailureErrorMessageTest

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/bd8c71c1f64147848b579ab3c9e57bc047acfd37
[releases_v114] Bug 1833874 - Replace connection error test steps