Closed Bug 1946571 Opened 1 year ago Closed 1 year ago

Intermittent [tier 2] org.mozilla.fenix.ui.BrowsingErrorPagesTest#verifyNoInternetConnectionErrorMessageTest | java.lang.AssertionError

Categories

(Firefox for Android :: UI Tests, defect, P5)

All
Android
defect

Tracking

()

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=493701253&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/foOB2NBYRF-4V79antww4Q/runs/0/artifacts/public/logs/live_backing.log


[task 2025-02-06T21:22:15.440Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a.yml --app /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-fenix --client-details matrixLabel=autoland,geckoRev=5ce0e05f6ec6347b7d804748971a52f94772ca95 --test /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk failed with exit code 10
[task 2025-02-06T21:22:15.495Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.BrowsingErrorPagesTest#verifyNoInternetConnectionErrorMessageTest | java.lang.AssertionError
[task 2025-02-06T21:22:15.495Z]  at org.junit.Assert.fail(Assert.java:87)
[task 2025-02-06T21:22:15.495Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-02-06T21:22:15.495Z]  at org.junit.Assert.assertTrue(Assert.java:53)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:440)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:140)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:137)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1453)
[task 2025-02-06T21:22:15.495Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest.verifyNoInternetConnectionErrorMessageTest(BrowsingErrorPagesTest.kt:137)
[task 2025-02-06T21:22:15.495Z] 
[task 2025-02-06T21:22:15.495Z]     
[task 2025-02-06T21:22:15.496Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.BrowsingErrorPagesTest#verifyNoInternetConnectionErrorMessageTest | java.lang.AssertionError: UiSelector[RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_progress] is not gone
[task 2025-02-06T21:22:15.496Z]  at org.junit.Assert.fail(Assert.java:89)
[task 2025-02-06T21:22:15.496Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectIsGone(MatcherHelper.kt:113)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.waitForPageToLoad(BrowserRobot.kt:80)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:139)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:137)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1453)
[task 2025-02-06T21:22:15.496Z]  at org.mozilla.fenix.ui.BrowsingErrorPagesTest.verifyNoInternetConnectionErrorMessageTest(BrowsingErrorPagesTest.kt:137)
[task 2025-02-06T21:22:15.496Z] 
[task 2025-02-06T21:22:15.496Z]     
[task 2025-02-06T21:22:15.496Z] ╔═══════════════════════════════════════════════════════════════════════════════════════╤═════════╤════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2025-02-06T21:22:15.496Z] ║ UI Test                                                                               │ Outcome │ Details                                                                                                                                                    ║
[task 2025-02-06T21:22:15.496Z] ╟───────────────────────────────────────────────────────────────────────────────────────┼─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-06T21:22:15.496Z] ║ org.mozilla.fenix.ui.BrowsingErrorPagesTest#verifyNoInternetConnectionErrorMessageTes │ Failure │ java.lang.AssertionError                                                                                                                                   ║
[task 2025-02-06T21:22:15.496Z] ║ t                                                                                     │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.junit.Assert.fail(Assert.java:87)                                                                                                                  ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.junit.Assert.assertTrue(Assert.java:42)                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.junit.Assert.assertTrue(Assert.java:53)                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)                                                               ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)                                                               ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:440)                                              ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)                                                                        ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:140)                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:137)                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1453)                                                                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest.verifyNoInternetConnectionErrorMessageTest(BrowsingErrorPagesTest.kt:137)                                  ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ╟───────────────────────────────────────────────────────────────────────────────────────┼─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-06T21:22:15.496Z] ║ org.mozilla.fenix.ui.BrowsingErrorPagesTest#verifyNoInternetConnectionErrorMessageTes │ Failure │ java.lang.AssertionError: UiSelector[RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_progress] is not gone                                    ║
[task 2025-02-06T21:22:15.496Z] ║ t                                                                                     │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.junit.Assert.fail(Assert.java:89)                                                                                                                  ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.junit.Assert.assertTrue(Assert.java:42)                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectIsGone(MatcherHelper.kt:113)                                                                     ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.waitForPageToLoad(BrowserRobot.kt:80)                                                                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:139)                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest$verifyNoInternetConnectionErrorMessageTest$3.invoke(BrowsingErrorPagesTest.kt:137)                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:1453)                                                                         ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.BrowsingErrorPagesTest.verifyNoInternetConnectionErrorMessageTest(BrowsingErrorPagesTest.kt:137)                                  ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ╟───────────────────────────────────────────────────────────────────────────────────────┼─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-06T21:22:15.496Z] ║ org.mozilla.fenix.ui.TranslationsTest#verifyTheShowOriginalTranslationOptionTest      │ Flaky   │ androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CONTAINS_DESCRIPTION=Page translated from French to English.]                              ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at androidx.test.uiautomator.UiObject.click(UiObject.java:378)                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.clickTranslateButton(NavigationToolbarRobot.kt:595)                                      ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.TranslationsTest.verifyTheShowOriginalTranslationOptionTest(TranslationsTest.kt:239)                                              ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.496Z] ╟───────────────────────────────────────────────────────────────────────────────────────┼─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-06T21:22:15.496Z] ║ org.mozilla.fenix.ui.NavigationToolbarComposeTest#saveAsPdfFunctionalityTest          │ Flaky   │ androidx.test.espresso.NoActivityResumedException: No activities in stage RESUMED. Did you forget to launch the activity. (test.getActivity() or similar)? ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at dalvik.system.VMStack.getThreadStackTrace(Native Method)                                                                                               ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at java.lang.Thread.getStackTrace(Thread.java:1841)                                                                                                       ║
[task 2025-02-06T21:22:15.496Z] ║                                                                                       │         │  at androidx.test.espresso.base.EspressoExceptionHandler.handleSafely(EspressoExceptionHandler.java:34)                                                    ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.base.EspressoExceptionHandler.handleSafely(EspressoExceptionHandler.java:26)                                                    ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.base.DefaultFailureHandler$TypedFailureHandler.handle(DefaultFailureHandler.java:158)                                           ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:120)                                                               ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:385)                                                    ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:366)                                                                                 ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.intent.Intents.intended(Intents.java:186)                                                                                       ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at androidx.test.espresso.intent.Intents.intended(Intents.java:164)                                                                                       ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.robots.DownloadRobot$Transition.clickOpen(DownloadRobot.kt:232)                                                                   ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │  at org.mozilla.fenix.ui.NavigationToolbarComposeTest.saveAsPdfFunctionalityTest(NavigationToolbarComposeTest.kt:212)                                      ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.501Z] ║                                                                                       │         │                                                                                                                                                            ║
[task 2025-02-06T21:22:15.501Z] ╚═══════════════════════════════════════════════════════════════════════════════════════╧═════════╧════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2025-02-06T21:22:15.501Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 2
[taskcluster 2025-02-06 21:22:15.816Z] === Task Finished ===
[taskcluster 2025-02-06 21:22:37.709Z] Unsuccessful task run with exit code: 10 completed in 1110.284 seconds

Seems to be network related as Gecko is seen trying to load example.com and stalling.

Component: General → UI Tests

When network is re-enabled [1], the test attempt's to reload example.com, but Gecko is stalling on the load. I think with Gecko logging we can determine if there is actual network here. Issue seems intermittent on matrices.

I'm not sure why this sometimes fails in "bursts" all of a sudden.

[1] https://searchfox.org/mozilla-central/source/mobile/android/fenix/app/src/androidTest/java/org/mozilla/fenix/ui/BrowsingErrorPagesTest.kt#135

Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 1 year ago → 1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 1 year ago → 1 year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: