Closed Bug 1842154 Opened 3 years ago Closed 2 years ago

Intermittent UI test failure - < DownloadTest.notificationCanBeDismissedIfDownloadIsInterruptedTest >

Categories

(Firefox for Android :: UI Tests, defect, P3)

Firefox 117
All
Android
defect

Tracking

()

RESOLVED FIXED
121 Branch
Tracking Status
firefox117 --- wontfix
firefox118 --- wontfix
firefox119 --- wontfix
firefox120 --- wontfix
firefox121 --- fixed
firefox122 --- wontfix
firefox123 --- wontfix
firefox126 --- unaffected
firefox127 --- unaffected
firefox128 --- wontfix
firefox129 --- wontfix
firefox130 --- disabled
firefox131 --- fixed

People

(Reporter: ajoltan, Assigned: ajoltan)

Details

(Keywords: intermittent-failure, test-disabled)

Attachments

(5 files)

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError at org.junit.Assert.fail(Assert.java:87) at org.junit.Assert.assertTrue(Assert.java:42) at org.junit.Assert.assertFalse(Assert.java:65) at org.junit.Assert.assertFalse(Assert.java:75) at org.mozilla.fenix.ui.robots.NotificationRobot.swipeDownloadNotification(NotificationRobot.kt:133) at org.mozilla.fenix.ui.robots.NotificationRobot.swipeDownloadNotification$default(NotificationRobot.kt:108) at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$7.invoke(DownloadTest.kt:443) at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$7.invoke(DownloadTest.kt:440) at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openNotificationShade(BrowserRobot.kt:1029) at org.mozilla.fenix.ui.DownloadTest.notificationCanBeDismissedIfDownloadIsInterruptedTest(DownloadTest.kt:440)

Build: 7/6 Main

► 7/11 Firebase link

► 7/31 Firebase link

► 8/23 Firebase link

► 8/25 Firebase link

► 9/6 Firebase link

► 9/23 Firebase link

► 11/15
Firebase link

Failed 1x
Firebase link
Firebase link

java.lang.AssertionError: UiSelector[TEXT=Download failed] does not exist at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.helpers.MatcherHelper.assertItemContainingTextExists(MatcherHelper.kt:79) at org.mozilla.fenix.helpers.MatcherHelper.assertItemContainingTextExists$default(MatcherHelper.kt:76) at org.mozilla.fenix.ui.robots.NotificationRobot.verifySystemNotificationExists(NotificationRobot.kt:40)

Authored by https://github.com/AndiAJ
https://github.com/mozilla-mobile/firefox-android/commit/d8587ca7c4dc3537e4be5e881745bc8e72d5e37f
[main] Bug 1842154 - Disable failing notificationCanBeDismissedIfDownloadIsInterruptedTest UI test

Status: NEW → RESOLVED
Closed: 2 years ago
Flags: qe-verify+
Resolution: --- → FIXED
Target Milestone: --- → 121 Branch
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Flags: qe-verify+

Authored by https://github.com/AndiAJ
https://github.com/mozilla-mobile/firefox-android/commit/4de4878afd5b3e0605c28d13d3b4e947d3eb9376
[main] Bug 1842154 - Fix notificationCanBeDismissedIfDownloadIsInterruptedTest UI test

Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Flags: qe-verify+
Resolution: --- → FIXED
Flags: qe-verify+

Flaky again, Firebase link the notification can not be found:

java.lang.AssertionError: UiSelector[CONTAINS_TEXT=Firefox Fenix] exists
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.junit.Assert.assertFalse(Assert.java:65)
	at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:102)
	at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92)
	at org.mozilla.fenix.ui.robots.NotificationRobot.swipeDownloadNotification(NotificationRobot.kt:165)
	at org.mozilla.fenix.ui.robots.NotificationRobot.swipeDownloadNotification$default(NotificationRobot.kt:132)
	at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$3.invoke(DownloadTest.kt:293)
	at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$3.invoke(DownloadTest.kt:290)
	at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openNotificationShade(BrowserRobot.kt:995)
	at org.mozilla.fenix.ui.DownloadTest.notificationCanBeDismissedIfDownloadIsInterruptedTest(DownloadTest.kt:290)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

► 12/7 Firebase link

► 12/12 Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:417) at androidx.test.uiautomator.UiScrollable.scrollToEnd(UiScrollable.java:595) at androidx.test.uiautomator.UiScrollable.scrollToEnd(UiScrollable.java:614) at org.mozilla.fenix.ui.robots.NotificationRobotKt.scrollToEnd(NotificationRobot.kt:262) at org.mozilla.fenix.ui.robots.NotificationRobotKt.access$scrollToEnd(NotificationRobot.kt:1) at org.mozilla.fenix.ui.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:47)

► 12/13 Firebase link

Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE

► 1/4 Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CONTAINS_TEXT=Firefox Fenix] at androidx.test.uiautomator.UiObject.getVisibleBounds(UiObject.java:895) at androidx.test.uiautomator.UiObject.swipeLeft(UiObject.java:319) at org.mozilla.fenix.ui.robots.NotificationRobot.swipeDownloadNotification(NotificationRobot.kt:150)

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Keywords: test-disabled

► 1/17 Failed 2x as the notification was not found, will disable the test again. Firebase link

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/9239d5d697cbda680aa768d56a51b6981e60398d
[main] Bug 1842154 - Disable notificationCanBeDismissedIfDownloadIsInterruptedTest UI test

Authored by oana.horvath
https://github.com/mozilla-mobile/firefox-android/commit/eb8061fc313c622f2a7b35c338968865e805381d
[releases_v122] Bug 1842154 - Disable notificationCanBeDismissedIfDownloadIsInterruptedTest UI test

Attachment #9401358 - Attachment description: WIP: Bug 1842154 - Re-enable download related UI tests → Bug 1842154 - Re-enable download related UI tests
Pushed by ajoltan@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/f710ac97b91d Re-enable download related UI tests r=ohorvath,jajohnson

► Failing on 6/5
Firebase link
Firebase link

java.lang.AssertionError: UiSelector[RESOURCE_ID=org.mozilla.fenix.debug:id/download_dialog_icon] does not exist at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100) at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) at org.mozilla.fenix.ui.robots.DownloadRobot.verifyDownloadFailedPrompt(DownloadRobot.kt:77) at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$1.invoke(DownloadTest.kt:256) at org.mozilla.fenix.ui.DownloadTest$notificationCanBeDismissedIfDownloadIsInterruptedTest$1.invoke(DownloadTest.kt:253) at org.mozilla.fenix.ui.robots.DownloadRobotKt.downloadRobot(DownloadRobot.kt:203) at org.mozilla.fenix.ui.DownloadTest.notificationCanBeDismissedIfDownloadIsInterruptedTest(DownloadTest.kt:253)

Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Keywords: test-disabled
Resolution: INCOMPLETE → ---
Assignee: nobody → ajoltan
Attachment #9417432 - Attachment description: WIP: Bug 1842154 - Fix notificationCanBeDismissedIfDownloadIsInterruptedTest UI test → Bug 1842154 - Fix notificationCanBeDismissedIfDownloadIsInterruptedTest UI test
Pushed by ajoltan@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/952508dcf0b2 Fix notificationCanBeDismissedIfDownloadIsInterruptedTest UI test r=ohorvath
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: