Closed Bug 1965300 Opened 6 days ago Closed 6 days ago

Perma [Tier-2] org.mozilla.fenix.ui.MainMenuTest#verifyTabMainMenuItemsTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Translate page] does not exist

Categories

(Firefox for Android :: UI Tests, defect, P5)

Product:
Firefox for Android
Component:
UI Tests
Platform:
All
Android
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
140 Branch
Tracking Flags:
Tracking Status
firefox140 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: aaronmt)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Bug 1965300 - Disable perma verifyTabMainMenuItemsTest
48 bytes, text/x-phabricator-request
Details | Review

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=507247852&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Izzh3WqcSuOpwwuYVhDbBA/runs/0/artifacts/public/logs/live_backing.log

[task 2025-05-08T17:38:53.448Z]   Shard 24: Expected: 0s, Actual: 922s, Diff: 922s
[task 2025-05-08T17:38:53.448Z]   Shard 25: Expected: 0s, Actual: 66s, Diff: 66s
[task 2025-05-08T17:38:53.448Z]   Shard 26: Expected: 0s, Actual: 83s, Diff: 83s
[task 2025-05-08T17:38:53.448Z]   Shard 27: Expected: 0s, Actual: 140s, Diff: 140s
[task 2025-05-08T17:38:53.448Z]   Shard 28: Expected: 0s, Actual: 109s, Diff: 109s
[task 2025-05-08T17:38:53.448Z]   Shard 29: Expected: 0s, Actual: 95s, Diff: 95s
[task 2025-05-08T17:38:53.448Z]   Shard 30: Expected: 0s, Actual: 99s, Diff: 99s
[task 2025-05-08T17:38:53.448Z]   Shard 31: Expected: 0s, Actual: 97s, Diff: 97s
[task 2025-05-08T17:38:53.448Z]   Shard 32: Expected: 0s, Actual: 121s, Diff: 121s
[task 2025-05-08T17:38:53.448Z]   Shard 33: Expected: 0s, Actual: 67s, Diff: 67s
[task 2025-05-08T17:38:53.448Z]   Shard 34: Expected: 0s, Actual: 81s, Diff: 81s
[task 2025-05-08T17:38:53.448Z]   Shard 35: Expected: 0s, Actual: 90s, Diff: 90s
[task 2025-05-08T17:38:53.448Z]   Shard 36: Expected: 0s, Actual: 49s, Diff: 49s
[task 2025-05-08T17:38:53.448Z]   Shard 37: Expected: 0s, Actual: 78s, Diff: 78s
[task 2025-05-08T17:38:53.448Z]   Shard 38: Expected: 0s, Actual: 89s, Diff: 89s
[task 2025-05-08T17:38:53.448Z]   Shard 39: Expected: 0s, Actual: 57s, Diff: 57s
[task 2025-05-08T17:38:53.448Z]   Shard 40: Expected: 0s, Actual: 56s, Diff: 56s
[task 2025-05-08T17:38:53.448Z]   Shard 41: Expected: 0s, Actual: 55s, Diff: 55s
[task 2025-05-08T17:38:53.448Z]   Shard 42: Expected: 0s, Actual: 116s, Diff: 116s
[task 2025-05-08T17:38:53.448Z]   Shard 43: Expected: 0s, Actual: 129s, Diff: 129s
[task 2025-05-08T17:38:53.448Z]   Shard 44: Expected: 0s, Actual: 55s, Diff: 55s
[task 2025-05-08T17:38:53.448Z]   Shard 45: Expected: 0s, Actual: 81s, Diff: 81s
[task 2025-05-08T17:38:53.448Z]   Shard 46: Expected: 0s, Actual: 83s, Diff: 83s
[task 2025-05-08T17:38:53.448Z]   Shard 47: Expected: 0s, Actual: 52s, Diff: 52s
[task 2025-05-08T17:38:53.448Z]   Shard 48: Expected: 0s, Actual: 56s, Diff: 56s
[task 2025-05-08T17:38:53.471Z]   Shard 49: Expected: 0s, Actual: 59s, Diff: 59s
[task 2025-05-08T17:38:53.471Z]   Shard 50: Expected: 0s, Actual: 117s, Diff: 117s
[task 2025-05-08T17:38:53.471Z]   Shard 51: Expected: 0s, Actual: 162s, Diff: 162s
[task 2025-05-08T17:38:53.471Z]   Shard 52: Expected: 0s, Actual: 120s, Diff: 120s
[task 2025-05-08T17:38:53.471Z]   Shard 53: Expected: 0s, Actual: 74s, Diff: 74s
[task 2025-05-08T17:38:53.471Z]   Shard 54: Expected: 0s, Actual: 69s, Diff: 69s
[task 2025-05-08T17:38:53.471Z]   Shard 55: Expected: 0s, Actual: 117s, Diff: 117s
[task 2025-05-08T17:38:53.471Z]   Shard 56: Expected: 0s, Actual: 93s, Diff: 93s
[task 2025-05-08T17:38:53.471Z]   Shard 57: Expected: 0s, Actual: 96s, Diff: 96s
[task 2025-05-08T17:38:53.471Z]   Shard 58: Expected: 0s, Actual: 91s, Diff: 91s
[task 2025-05-08T17:38:53.471Z]   Shard 59: Expected: 0s, Actual: 77s, Diff: 77s
[task 2025-05-08T17:38:53.471Z]   Shard 60: Expected: 0s, Actual: 125s, Diff: 125s
[task 2025-05-08T17:38:53.471Z]   Shard 61: Expected: 0s, Actual: 132s, Diff: 132s
[task 2025-05-08T17:38:53.471Z]   Shard 62: Expected: 0s, Actual: 143s, Diff: 143s
[task 2025-05-08T17:38:53.471Z]   Shard 63: Expected: 0s, Actual: 200s, Diff: 200s
[task 2025-05-08T17:38:53.471Z]   Shard 64: Expected: 0s, Actual: 153s, Diff: 153s
[task 2025-05-08T17:38:53.471Z]   Shard 65: Expected: 0s, Actual: 128s, Diff: 128s
[task 2025-05-08T17:38:53.471Z]   Shard 66: Expected: 0s, Actual: 90s, Diff: 90s
[task 2025-05-08T17:38:53.471Z]   Shard 67: Expected: 0s, Actual: 102s, Diff: 102s
[task 2025-05-08T17:38:53.471Z]   Shard 68: Expected: 0s, Actual: 82s, Diff: 82s
[task 2025-05-08T17:38:53.471Z]   Shard 69: Expected: 0s, Actual: 116s, Diff: 116s
[task 2025-05-08T17:38:53.471Z]   Shard 70: Expected: 0s, Actual: 79s, Diff: 79s
[task 2025-05-08T17:38:53.471Z]   Shard 71: Expected: 0s, Actual: 98s, Diff: 98s
[task 2025-05-08T17:38:53.471Z]   Shard 72: Expected: 0s, Actual: 118s, Diff: 118s
[task 2025-05-08T17:38:53.471Z]   Shard 73: Expected: 0s, Actual: 75s, Diff: 75s
[task 2025-05-08T17:38:53.471Z]   Shard 74: Expected: 0s, Actual: 152s, Diff: 152s
[task 2025-05-08T17:38:53.471Z]   Shard 75: Expected: 0s, Actual: 115s, Diff: 115s
[task 2025-05-08T17:38:53.471Z]   Shard 76: Expected: 0s, Actual: 84s, Diff: 84s
[task 2025-05-08T17:38:53.471Z]   Shard 77: Expected: 0s, Actual: 62s, Diff: 62s
[task 2025-05-08T17:38:53.471Z]   Shard 78: Expected: 0s, Actual: 92s, Diff: 92s
[task 2025-05-08T17:38:53.471Z]   Shard 79: Expected: 0s, Actual: 86s, Diff: 86s
[task 2025-05-08T17:38:53.471Z]   Shard 80: Expected: 0s, Actual: 83s, Diff: 83s
[task 2025-05-08T17:38:53.471Z]   Shard 81: Expected: 0s, Actual: 109s, Diff: 109s
[task 2025-05-08T17:38:53.471Z]   Shard 82: Expected: 0s, Actual: 91s, Diff: 91s
[task 2025-05-08T17:38:53.471Z]   Shard 83: Expected: 0s, Actual: 50s, Diff: 50s
[task 2025-05-08T17:38:53.471Z]   Shard 84: Expected: 0s, Actual: 136s, Diff: 136s
[task 2025-05-08T17:38:53.471Z]   Shard 85: Expected: 0s, Actual: 134s, Diff: 134s
[task 2025-05-08T17:38:53.471Z]   Shard 86: Expected: 0s, Actual: 51s, Diff: 51s
[task 2025-05-08T17:38:53.471Z]   Shard 87: Expected: 0s, Actual: 79s, Diff: 79s
[task 2025-05-08T17:38:53.471Z]   Shard 88: Expected: 0s, Actual: 48s, Diff: 48s
[task 2025-05-08T17:38:53.471Z]   Shard 89: Expected: 0s, Actual: 94s, Diff: 94s
[task 2025-05-08T17:38:53.471Z]   Shard 90: Expected: 0s, Actual: 54s, Diff: 54s
[task 2025-05-08T17:38:53.471Z]   Shard 91: Expected: 0s, Actual: 70s, Diff: 70s
[task 2025-05-08T17:38:53.471Z]   Shard 92: Expected: 0s, Actual: 96s, Diff: 96s
[task 2025-05-08T17:38:53.471Z]   Shard 93: Expected: 0s, Actual: 106s, Diff: 106s
[task 2025-05-08T17:38:53.471Z]   Shard 94: Expected: 0s, Actual: 62s, Diff: 62s
[task 2025-05-08T17:38:53.471Z]   Shard 95: Expected: 0s, Actual: 121s, Diff: 121s
[task 2025-05-08T17:38:53.471Z]   Shard 96: Expected: 0s, Actual: 109s, Diff: 109s
[task 2025-05-08T17:38:53.471Z]   Shard 97: Expected: 0s, Actual: 52s, Diff: 52s
[task 2025-05-08T17:38:53.471Z]   Shard 98: Expected: 0s, Actual: 67s, Diff: 67s
[task 2025-05-08T17:38:53.471Z]   Shard 99: Expected: 0s, Actual: 104s, Diff: 104s
[task 2025-05-08T17:38:53.472Z] 
[task 2025-05-08T17:38:53.472Z] 
[task 2025-05-08T17:38:53.472Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a-detect-leaks.yml --app /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-fenix --client-details matrixLabel=autoland,geckoRev=844bc8d2ad1e2f8ff93e6e2e38d1175442877bb8 --test /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk failed with exit code 10
[task 2025-05-08T17:38:53.573Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.MainMenuTest#verifyTabMainMenuItemsTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Translate page] does not exist
[task 2025-05-08T17:38:53.573Z]  at org.junit.Assert.fail(Assert.java:89)
[task 2025-05-08T17:38:53.573Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:110)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:102)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.robots.ThreeDotMenuMainRobot.verifyPageThreeDotMainMenuItems(ThreeDotMenuMainRobot.kt:166)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.MainMenuTest.verifyTabMainMenuItemsTest$lambda$4(MainMenuTest.kt:65)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.MainMenuTest.$r8$lambda$YfC59LJgopMTLMVmPGs3u5IzozQ(Unknown Source:0)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.MainMenuTest$$ExternalSyntheticLambda120.invoke(D8$$SyntheticClass:0)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openThreeDotMenu(BrowserRobot.kt:1308)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.MainMenuTest.verifyTabMainMenuItemsTest(MainMenuTest.kt:64)
[task 2025-05-08T17:38:53.573Z] 
[task 2025-05-08T17:38:53.573Z]     
[task 2025-05-08T17:38:53.573Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.SettingsSearchTest#verifySearchShortcutChangesAreReflectedInSearchSelectorMenuTest | java.lang.AssertionError: UiSelector[CHILD=UiSelector[TEXT=Reddit], RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_menu_recyclerView] does not exist
[task 2025-05-08T17:38:53.573Z]  at org.junit.Assert.fail(Assert.java:89)
[task 2025-05-08T17:38:53.573Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:110)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:102)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.robots.SearchRobot.verifySearchShortcutListContains(SearchRobot.kt:277)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.SettingsSearchTest.verifySearchShortcutChangesAreReflectedInSearchSelectorMenuTest$lambda$145(SettingsSearchTest.kt:684)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.SettingsSearchTest.$r8$lambda$gxO_wJHeAFIKKd_hxkW4ZarRbBM(Unknown Source:0)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.SettingsSearchTest$$ExternalSyntheticLambda85.invoke(D8$$SyntheticClass:0)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.robots.SearchRobotKt.searchScreen(SearchRobot.kt:498)
[task 2025-05-08T17:38:53.573Z]  at org.mozilla.fenix.ui.SettingsSearchTest.verifySearchShortcutChangesAreReflectedInSearchSelectorMenuTest(SettingsSearchTest.kt:680)
[task 2025-05-08T17:38:53.573Z] 
[task 2025-05-08T17:38:53.573Z]     
[task 2025-05-08T17:38:53.573Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.SearchTest#searchHistoryNotRememberedInPrivateBrowsingTest | androidx.compose.ui.test.ComposeTimeoutException: Condition (exactly 1 nodes match (Text + EditableText contains 'TestSearchEngine search' (ignoreCase: false))) still not satisfied after 15000 ms
[task 2025-05-08T17:38:53.573Z]  at androidx.compose.ui.test.AndroidComposeUiTestEnvironment$AndroidComposeUiTestImpl.waitUntil(ComposeUiTest.android.kt:441)
[task 2025-05-08T17:38:53.573Z]  at androidx.compose.ui.test.ComposeUiTestKt.waitUntilNodeCount(ComposeUiTest.kt:214)
[task 2025-05-08T17:38:53.573Z]  at androidx.compose.ui.test.ComposeUiTestKt.waitUntilExactlyOneExists(ComposeUiTest.kt:257)
[task 2025-05-08T17:38:53.573Z]  at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntilExactlyOneExists(AndroidComposeTestRule.android.kt:326)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.robots.SearchRobot.verifyTheSuggestionsHeader(SearchRobot.kt:91)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.SearchTest.searchHistoryNotRememberedInPrivateBrowsingTest$lambda$178(SearchTest.kt:907)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.SearchTest.$r8$lambda$ADxPf3U5gDY-riS9LKePI8ANBlg(Unknown Source:0)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.SearchTest$$ExternalSyntheticLambda145.invoke(D8$$SyntheticClass:0)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.clickUrlbar(NavigationToolbarRobot.kt:570)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.SearchTest.searchHistoryNotRememberedInPrivateBrowsingTest(SearchTest.kt:904)
[task 2025-05-08T17:38:53.574Z] 
[task 2025-05-08T17:38:53.574Z]     
[task 2025-05-08T17:38:53.574Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.TranslationsTest#downloadLanguageWhileDataSaverModeIsOnTest | androidx.compose.ui.test.ComposeTimeoutException: Condition (at least one node matches (ContentDescription = 'Bosnian 17.94 MBDelete' (ignoreCase: false))) still not satisfied after 15000 ms
[task 2025-05-08T17:38:53.574Z]  at androidx.compose.ui.test.AndroidComposeUiTestEnvironment$AndroidComposeUiTestImpl.waitUntil(ComposeUiTest.android.kt:441)
[task 2025-05-08T17:38:53.574Z]  at androidx.compose.ui.test.ComposeUiTestKt.waitUntilAtLeastOneExists(ComposeUiTest.kt:236)
[task 2025-05-08T17:38:53.574Z]  at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntilAtLeastOneExists(AndroidComposeTestRule.android.kt:322)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.robots.SettingsTranslationsRobot.verifyDownloadedLanguage(SettingsTranslationsRobot.kt:46)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.TranslationsTest.downloadLanguageWhileDataSaverModeIsOnTest$lambda$104(TranslationsTest.kt:420)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.TranslationsTest.$r8$lambda$SEkxAavZJOeTYZ4uu_aQb6Yy8yM(Unknown Source:0)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.TranslationsTest$$ExternalSyntheticLambda22.invoke(D8$$SyntheticClass:0)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.robots.TranslationsRobot$Transition.clickTranslationSettingsButton(TranslationsRobot.kt:356)
[task 2025-05-08T17:38:53.574Z]  at org.mozilla.fenix.ui.TranslationsTest.downloadLanguageWhileDataSaverModeIsOnTest(TranslationsTest.kt:410)
Summary: Intermittent org.mozilla.fenix.ui.MainMenuTest#verifyTabMainMenuItemsTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Translate page] does not exist → Perma [Tier-2] org.mozilla.fenix.ui.MainMenuTest#verifyTabMainMenuItemsTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Translate page] does not exist

The Bugbug bot thinks this bug should belong to the 'Firefox for Android::UI Tests' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Component: General → UI Tests
Assignee: nobody → aaron.train
Attachment #9486400 - Attachment description: WIP: Bug 1965300 - Disable perma verifyTabMainMenuItemsTest → Bug 1965300 - Disable perma verifyTabMainMenuItemsTest
Status: NEW → ASSIGNED
Pushed by atrain@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/dd5facdb1f2e Disable perma verifyTabMainMenuItemsTest r=android-reviewers,Roger

https://hg.mozilla.org/mozilla-central/rev/dd5facdb1f2e

Status: ASSIGNED → RESOLVED
Closed: 6 days ago
status-firefox140: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 140 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: