Closed Bug 1937822 Opened 2 months ago Closed 2 months ago

Intermittent [tier 2] org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest | single tracking bug

Categories

(Focus :: UI Tests, defect, P5)

All
Android
defect

Tracking

(firefox134 fixed, firefox135 fixed)

RESOLVED FIXED
135 Branch
Tracking Status
firefox134 --- fixed
firefox135 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ajoltan)

References

Details

(Keywords: intermittent-failure)

Attachments

(2 files)

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=487288746&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BI4d0P3bRzmTYKz2O-vVuQ/runs/0/artifacts/public/logs/live_backing.log


[task 2024-12-17T17:02:03.022Z]   CostReport
[task 2024-12-17T17:02:03.022Z]   Virtual devices
[task 2024-12-17T17:02:03.022Z]     $1.17 for 1h 10m
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] MatrixResultsReport
[task 2024-12-17T17:02:03.022Z]   0 / 1 (0.00%)
[task 2024-12-17T17:02:03.022Z]   1 matrices failed
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] ┌─────────┬──────────────────────┬──────────┬──────────────────┬───────────────────────────────────┬──────────────────────────────────────────┐
[task 2024-12-17T17:02:03.022Z] │ OUTCOME │      MATRIX ID       │ APP NAME │  TEST FILE NAME  │          TEST AXIS VALUE          │               TEST DETAILS               │
[task 2024-12-17T17:02:03.022Z] ├─────────┼──────────────────────┼──────────┼──────────────────┼───────────────────────────────────┼──────────────────────────────────────────┤
[task 2024-12-17T17:02:03.022Z] │ failure │ matrix-35b2c43bjvonu │ app.apk  │ android-test.apk │ MediumPhone.arm-34-en_US-portrait │ 1 test cases failed, 116 passed, 1 flaky │
[task 2024-12-17T17:02:03.022Z] └─────────┴──────────────────────┴──────────┴──────────────────┴───────────────────────────────────┴──────────────────────────────────────────┘
[task 2024-12-17T17:02:03.022Z] More details are available at:
[task 2024-12-17T17:02:03.022Z] https://console.firebase.google.com/project/moz-focus-android/testlab/histories/bh.2189b040bbce6d5a/matrices/7976768134849585790/details
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] 
[task 2024-12-17T17:02:03.022Z] Matrices webLink
[task 2024-12-17T17:02:03.022Z]   matrix-35b2c43bjvonu https://console.firebase.google.com/project/moz-focus-android/testlab/histories/bh.2189b040bbce6d5a/matrices/7976768134849585790/details
[task 2024-12-17T17:02:03.022Z] Actual shard times:
[task 2024-12-17T17:02:03.022Z]   Shard 0: Expected: 0s, Actual: 65s, Diff: 65s
[task 2024-12-17T17:02:03.022Z]   Shard 1: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.022Z]   Shard 2: Expected: 0s, Actual: 29s, Diff: 29s
[task 2024-12-17T17:02:03.022Z]   Shard 3: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.022Z]   Shard 4: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.022Z]   Shard 5: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.022Z]   Shard 6: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.022Z]   Shard 7: Expected: 0s, Actual: 51s, Diff: 51s
[task 2024-12-17T17:02:03.022Z]   Shard 8: Expected: 0s, Actual: 61s, Diff: 61s
[task 2024-12-17T17:02:03.022Z]   Shard 9: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.022Z]   Shard 10: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.022Z]   Shard 11: Expected: 0s, Actual: 42s, Diff: 42s
[task 2024-12-17T17:02:03.022Z]   Shard 12: Expected: 0s, Actual: 29s, Diff: 29s
[task 2024-12-17T17:02:03.022Z]   Shard 13: Expected: 0s, Actual: 42s, Diff: 42s
[task 2024-12-17T17:02:03.022Z]   Shard 14: Expected: 0s, Actual: 60s, Diff: 60s
[task 2024-12-17T17:02:03.022Z]   Shard 15: Expected: 0s, Actual: 16s, Diff: 16s
[task 2024-12-17T17:02:03.022Z]   Shard 16: Expected: 0s, Actual: 10s, Diff: 10s
[task 2024-12-17T17:02:03.022Z]   Shard 17: Expected: 0s, Actual: 33s, Diff: 33s
[task 2024-12-17T17:02:03.022Z]   Shard 18: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.022Z]   Shard 19: Expected: 0s, Actual: 43s, Diff: 43s
[task 2024-12-17T17:02:03.022Z]   Shard 20: Expected: 0s, Actual: 21s, Diff: 21s
[task 2024-12-17T17:02:03.023Z]   Shard 21: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.023Z]   Shard 22: Expected: 0s, Actual: 23s, Diff: 23s
[task 2024-12-17T17:02:03.023Z]   Shard 23: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.023Z]   Shard 24: Expected: 0s, Actual: 12s, Diff: 12s
[task 2024-12-17T17:02:03.023Z]   Shard 25: Expected: 0s, Actual: 14s, Diff: 14s
[task 2024-12-17T17:02:03.023Z]   Shard 26: Expected: 0s, Actual: 13s, Diff: 13s
[task 2024-12-17T17:02:03.023Z]   Shard 27: Expected: 0s, Actual: 12s, Diff: 12s
[task 2024-12-17T17:02:03.023Z]   Shard 28: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z]   Shard 29: Expected: 0s, Actual: 38s, Diff: 38s
[task 2024-12-17T17:02:03.023Z]   Shard 30: Expected: 0s, Actual: 15s, Diff: 15s
[task 2024-12-17T17:02:03.023Z]   Shard 31: Expected: 0s, Actual: 23s, Diff: 23s
[task 2024-12-17T17:02:03.023Z]   Shard 32: Expected: 0s, Actual: 39s, Diff: 39s
[task 2024-12-17T17:02:03.023Z]   Shard 33: Expected: 0s, Actual: 79s, Diff: 79s
[task 2024-12-17T17:02:03.023Z]   Shard 34: Expected: 0s, Actual: 127s, Diff: 127s
[task 2024-12-17T17:02:03.023Z]   Shard 35: Expected: 0s, Actual: 45s, Diff: 45s
[task 2024-12-17T17:02:03.023Z]   Shard 36: Expected: 0s, Actual: 54s, Diff: 54s
[task 2024-12-17T17:02:03.023Z]   Shard 37: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z]   Shard 38: Expected: 0s, Actual: 41s, Diff: 41s
[task 2024-12-17T17:02:03.023Z]   Shard 39: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.023Z]   Shard 40: Expected: 0s, Actual: 35s, Diff: 35s
[task 2024-12-17T17:02:03.023Z]   Shard 41: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z]   Shard 42: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z]   Shard 43: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z]   Shard 35: Expected: 0s, Actual: 45s, Diff: 45s
[task 2024-12-17T17:02:03.023Z]   Shard 36: Expected: 0s, Actual: 54s, Diff: 54s
[task 2024-12-17T17:02:03.023Z]   Shard 37: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z]   Shard 38: Expected: 0s, Actual: 41s, Diff: 41s
[task 2024-12-17T17:02:03.023Z]   Shard 39: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.023Z]   Shard 40: Expected: 0s, Actual: 35s, Diff: 35s
[task 2024-12-17T17:02:03.023Z]   Shard 41: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z]   Shard 42: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z]   Shard 43: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z]   Shard 44: Expected: 0s, Actual: 33s, Diff: 33s
[task 2024-12-17T17:02:03.023Z]   Shard 45: Expected: 0s, Actual: 20s, Diff: 20s
[task 2024-12-17T17:02:03.023Z]   Shard 46: Expected: 0s, Actual: 75s, Diff: 75s
[task 2024-12-17T17:02:03.023Z]   Shard 47: Expected: 0s, Actual: 72s, Diff: 72s
[task 2024-12-17T17:02:03.023Z]   Shard 48: Expected: 0s, Actual: 27s, Diff: 27s
[task 2024-12-17T17:02:03.023Z]   Shard 49: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z] 
[task 2024-12-17T17:02:03.023Z] 
[task 2024-12-17T17:02:03.023Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a.yml --app /builds/worker/checkouts/gecko/mobile/android/focus-android/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-focus-android --client-details matrixLabel=autoland,geckoRev=f9f069f580c6c979fa9eb5d7d079ad86604e35cb --test /builds/worker/checkouts/gecko/mobile/android/focus-android/android-test.apk failed with exit code 10
[task 2024-12-17T17:02:03.064Z] TEST-UNEXPECTED-FAIL | org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest | androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller]
[task 2024-12-17T17:02:03.064Z]  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353)
[task 2024-12-17T17:02:03.064Z]  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336)
[task 2024-12-17T17:02:03.064Z]  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260)
[task 2024-12-17T17:02:03.064Z]  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235)
[task 2024-12-17T17:02:03.064Z]  at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28)
[task 2024-12-17T17:02:03.065Z]  at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:77)
[task 2024-12-17T17:02:03.065Z]  at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:75)
[task 2024-12-17T17:02:03.065Z]  at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126)
[task 2024-12-17T17:02:03.065Z]  at org.mozilla.focus.activity.DownloadFileTest.downloadNotificationTest(DownloadFileTest.kt:75)
[task 2024-12-17T17:02:03.065Z] 
[task 2024-12-17T17:02:03.065Z]     
[task 2024-12-17T17:02:03.065Z] ╔═════════════════════════════════════════════════════════════════════════╤═════════╤══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2024-12-17T17:02:03.065Z] ║ UI Test                                                                 │ Outcome │ Details                                                                                                                          ║
[task 2024-12-17T17:02:03.065Z] ╟─────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-12-17T17:02:03.065Z] ║ org.mozilla.focus.activity.SwitchContextTest#notificationOpenButtonTest │ Flaky   │ androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353)                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336)                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260)                                                 ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235)                                                 ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28)                              ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.SwitchContextTest$setUp$2.invoke(SwitchContextTest.kt:52)                                         ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.SwitchContextTest$setUp$2.invoke(SwitchContextTest.kt:50)                                         ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126)                             ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.SwitchContextTest.setUp(SwitchContextTest.kt:50)                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │                                                                                                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │                                                                                                                                  ║
[task 2024-12-17T17:02:03.065Z] ╟─────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-12-17T17:02:03.065Z] ║ org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest    │ Failure │ androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353)                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336)                                                  ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260)                                                 ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235)                                                 ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28)                              ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:77)                        ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:75)                        ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126)                             ║
[task 2024-12-17T17:02:03.065Z] ║                                                                         │         │  at org.mozilla.focus.activity.DownloadFileTest.downloadNotificationTest(DownloadFileTest.kt:75)                                 ║
[task 2024-12-17T17:02:03.070Z] ║                                                                         │         │                                                                                                                                  ║
[task 2024-12-17T17:02:03.071Z] ║                                                                         │         │                                                                                                                                  ║
[task 2024-12-17T17:02:03.071Z] ╚═════════════════════════════════════════════════════════════════════════╧═════════╧══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2024-12-17T17:02:03.071Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 1
[taskcluster 2024-12-17 17:02:03.625Z] === Task Finished ===
[taskcluster 2024-12-17 17:02:17.162Z] Unsuccessful task run with exit code: 10 completed in 696.108 seconds
Component: General → UI Tests

I think Google Play Services 24.45.34 seems unstable here versus 24.43.37 green on other matrices affecting the outcomes of tests that check for com.android.systemui:id/notification_stack_scroller elements. Unfortunately we have no control on what Firebase team deploys for Google Play Services so we'll need to investigate here if there's any work-around.

See also https://bugzilla.mozilla.org/show_bug.cgi?id=1937820

See Also: → 1937820
Assignee: nobody → ajoltan
Attachment #9444333 - Attachment description: WIP: Bug 1937822 - Fix failing UI tests affected by GPS update → Bug 1937822 - Fix failing UI tests affected by GPS update
Status: NEW → ASSIGNED
Pushed by ajoltan@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/65c58bcf1e2f Fix failing UI tests affected by GPS update r=ohorvath
Status: ASSIGNED → RESOLVED
Closed: 2 months ago
Resolution: --- → FIXED
Target Milestone: --- → 135 Branch

5 UI tests started to fail all of a sudden.
The failures were occurring when trying to clear the system notifications before running the UI tests.
As Aaron pointed out these failures might be related to a GPS update (updated to 24.45.34)

Considering that we do the same thing (clear the notifications before running certain test) on Fenix, and that Fenix wasn't affected by the GPS update, I've moved the implementation from Fenix to Focus. (the main change is related to identifying the clearButton)

Original Revision: https://phabricator.services.mozilla.com/D232493

Attachment #9444502 - Flags: approval-mozilla-beta?

beta Uplift Approval Request

  • User impact if declined: None
  • Code covered by automated testing: yes
  • Fix verified in Nightly: yes
  • Needs manual QE test: no
  • Steps to reproduce for manual QE testing: None
  • Risk associated with taking this patch: None
  • Explanation of risk level: None
  • String changes made/needed: No
  • Is Android affected?: yes
Attachment #9444502 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: