Closed Bug 1972487 Opened 9 months ago Closed 9 months ago

Intermittent UI test failure - < TranslationsTest. verifyTheNeverTranslateOptionTest >

Categories

(Firefox for Android :: UI Tests, defect, P3)

All
Android
defect

Tracking

()

RESOLVED FIXED
141 Branch
Tracking Status
firefox139 --- unaffected
firefox140 --- fixed
firefox141 --- fixed

People

(Reporter: ajoltan, Assigned: ajoltan)

References

Details

(Keywords: intermittent-failure)

Attachments

(2 files)

Firebase Test Run: Failed

Firebase link
Firebase link

Stacktrace:

androidx.compose.ui.test.ComposeTimeoutException: Condition (exactly 1 nodes match (Text + EditableText contains 'French' (ignoreCase: false))) still not satisfied after 15000 ms
at androidx.compose.ui.test.AndroidComposeUiTestEnvironment$AndroidComposeUiTestImpl.waitUntil(ComposeUiTest.android.kt:441)
at androidx.compose.ui.test.ComposeUiTestKt.waitUntilNodeCount(ComposeUiTest.kt:214)
at androidx.compose.ui.test.ComposeUiTestKt.waitUntilExactlyOneExists(ComposeUiTest.kt:257)
at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntilExactlyOneExists(AndroidComposeTestRule.android.kt:326)
at org.mozilla.fenix.ui.robots.SettingsTranslationsRobot.verifyAlwaysAutomaticallyTranslateForLanguage(SettingsTranslationsRobot.kt:119)
at org.mozilla.fenix.ui.TranslationsTest.verifyTheAlwaysTranslateOptionTest$lambda$87(TranslationsTest.kt:341)
at org.mozilla.fenix.ui.TranslationsTest.$r8$lambda$uExJUxRvqWhDuTwedIunbVxZdIM(Unknown Source:0)
at org.mozilla.fenix.ui.TranslationsTest$$ExternalSyntheticLambda84.invoke(D8$$SyntheticClass:0)
at org.mozilla.fenix.ui.robots.TranslationsRobot$Transition.clickTranslationSettingsButton(TranslationsRobot.kt:356)
at org.mozilla.fenix.ui.TranslationsTest.verifyTheAlwaysTranslateOptionTest(TranslationsTest.kt:339)

Build: 6/16 mozilla-release

Summary: Intermittent UI test failure - < TranslationsTest. verifyTheAlwaysTranslateOptionTest > → Intermittent UI test failure - < TranslationsTest. verifyTheNeverTranslateOptionTest >
Assignee: nobody → ajoltan
Attachment #9495177 - Attachment description: WIP: Bug 1972487 - Fix failing nevever/always translate option UI tests → Bug 1972487 - Fix failing nevever/always translate option UI tests
Status: NEW → ASSIGNED
Status: ASSIGNED → RESOLVED
Closed: 9 months ago
Resolution: --- → FIXED
Target Milestone: --- → 141 Branch

All translations related UI tests are disabled on main, on the other hand verifyTheAlwaysTranslateOptionTest and verifyTheNeverTranslateOptionTest started to fail on the Beta 140 and RC 140 branches.

The UI tests were failing when trying to verify the language in the always/never automatically translate settings option list.

This happened because the French language isn't located on the top of the list anymore, it's now being displayed in the lower part of the list.
To be able to verify and interact with it I had to add a scrolling action.

Both UI tests successfully passed 10x using these changes with the Beta branch ✅
Both UI tests successfully passed 10x using these changes with the Release branch ✅

Original Revision: https://phabricator.services.mozilla.com/D253981

Attachment #9496918 - Flags: approval-mozilla-release?

firefox-release Uplift Approval Request

  • User impact if declined: None
  • Code covered by automated testing: yes
  • Fix verified in Nightly: yes
  • Needs manual QE test: no
  • Steps to reproduce for manual QE testing: N/A
  • Risk associated with taking this patch: None
  • Explanation of risk level: N/A
  • String changes made/needed: No
  • Is Android affected?: yes
Attachment #9496918 - Flags: approval-mozilla-release? → approval-mozilla-release+
Blocks: 2000207
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: