Intermittent [tier 2] org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest | single tracking bug
Categories
(Focus :: UI Tests, defect, P5)
Tracking
(firefox134 fixed, firefox135 fixed)
People
(Reporter: intermittent-bug-filer, Assigned: ajoltan)
References
Details
(Keywords: intermittent-failure)
Attachments
(2 files)
48 bytes,
text/x-phabricator-request
|
Details | Review | |
48 bytes,
text/x-phabricator-request
|
phab-bot
:
approval-mozilla-beta+
|
Details | Review |
Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=487288746&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BI4d0P3bRzmTYKz2O-vVuQ/runs/0/artifacts/public/logs/live_backing.log
[task 2024-12-17T17:02:03.022Z] CostReport
[task 2024-12-17T17:02:03.022Z] Virtual devices
[task 2024-12-17T17:02:03.022Z] $1.17 for 1h 10m
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z] MatrixResultsReport
[task 2024-12-17T17:02:03.022Z] 0 / 1 (0.00%)
[task 2024-12-17T17:02:03.022Z] 1 matrices failed
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z] ┌─────────┬──────────────────────┬──────────┬──────────────────┬───────────────────────────────────┬──────────────────────────────────────────┐
[task 2024-12-17T17:02:03.022Z] │ OUTCOME │ MATRIX ID │ APP NAME │ TEST FILE NAME │ TEST AXIS VALUE │ TEST DETAILS │
[task 2024-12-17T17:02:03.022Z] ├─────────┼──────────────────────┼──────────┼──────────────────┼───────────────────────────────────┼──────────────────────────────────────────┤
[task 2024-12-17T17:02:03.022Z] │ failure │ matrix-35b2c43bjvonu │ app.apk │ android-test.apk │ MediumPhone.arm-34-en_US-portrait │ 1 test cases failed, 116 passed, 1 flaky │
[task 2024-12-17T17:02:03.022Z] └─────────┴──────────────────────┴──────────┴──────────────────┴───────────────────────────────────┴──────────────────────────────────────────┘
[task 2024-12-17T17:02:03.022Z] More details are available at:
[task 2024-12-17T17:02:03.022Z] https://console.firebase.google.com/project/moz-focus-android/testlab/histories/bh.2189b040bbce6d5a/matrices/7976768134849585790/details
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z]
[task 2024-12-17T17:02:03.022Z] Matrices webLink
[task 2024-12-17T17:02:03.022Z] matrix-35b2c43bjvonu https://console.firebase.google.com/project/moz-focus-android/testlab/histories/bh.2189b040bbce6d5a/matrices/7976768134849585790/details
[task 2024-12-17T17:02:03.022Z] Actual shard times:
[task 2024-12-17T17:02:03.022Z] Shard 0: Expected: 0s, Actual: 65s, Diff: 65s
[task 2024-12-17T17:02:03.022Z] Shard 1: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.022Z] Shard 2: Expected: 0s, Actual: 29s, Diff: 29s
[task 2024-12-17T17:02:03.022Z] Shard 3: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.022Z] Shard 4: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.022Z] Shard 5: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.022Z] Shard 6: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.022Z] Shard 7: Expected: 0s, Actual: 51s, Diff: 51s
[task 2024-12-17T17:02:03.022Z] Shard 8: Expected: 0s, Actual: 61s, Diff: 61s
[task 2024-12-17T17:02:03.022Z] Shard 9: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.022Z] Shard 10: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.022Z] Shard 11: Expected: 0s, Actual: 42s, Diff: 42s
[task 2024-12-17T17:02:03.022Z] Shard 12: Expected: 0s, Actual: 29s, Diff: 29s
[task 2024-12-17T17:02:03.022Z] Shard 13: Expected: 0s, Actual: 42s, Diff: 42s
[task 2024-12-17T17:02:03.022Z] Shard 14: Expected: 0s, Actual: 60s, Diff: 60s
[task 2024-12-17T17:02:03.022Z] Shard 15: Expected: 0s, Actual: 16s, Diff: 16s
[task 2024-12-17T17:02:03.022Z] Shard 16: Expected: 0s, Actual: 10s, Diff: 10s
[task 2024-12-17T17:02:03.022Z] Shard 17: Expected: 0s, Actual: 33s, Diff: 33s
[task 2024-12-17T17:02:03.022Z] Shard 18: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.022Z] Shard 19: Expected: 0s, Actual: 43s, Diff: 43s
[task 2024-12-17T17:02:03.022Z] Shard 20: Expected: 0s, Actual: 21s, Diff: 21s
[task 2024-12-17T17:02:03.023Z] Shard 21: Expected: 0s, Actual: 63s, Diff: 63s
[task 2024-12-17T17:02:03.023Z] Shard 22: Expected: 0s, Actual: 23s, Diff: 23s
[task 2024-12-17T17:02:03.023Z] Shard 23: Expected: 0s, Actual: 25s, Diff: 25s
[task 2024-12-17T17:02:03.023Z] Shard 24: Expected: 0s, Actual: 12s, Diff: 12s
[task 2024-12-17T17:02:03.023Z] Shard 25: Expected: 0s, Actual: 14s, Diff: 14s
[task 2024-12-17T17:02:03.023Z] Shard 26: Expected: 0s, Actual: 13s, Diff: 13s
[task 2024-12-17T17:02:03.023Z] Shard 27: Expected: 0s, Actual: 12s, Diff: 12s
[task 2024-12-17T17:02:03.023Z] Shard 28: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z] Shard 29: Expected: 0s, Actual: 38s, Diff: 38s
[task 2024-12-17T17:02:03.023Z] Shard 30: Expected: 0s, Actual: 15s, Diff: 15s
[task 2024-12-17T17:02:03.023Z] Shard 31: Expected: 0s, Actual: 23s, Diff: 23s
[task 2024-12-17T17:02:03.023Z] Shard 32: Expected: 0s, Actual: 39s, Diff: 39s
[task 2024-12-17T17:02:03.023Z] Shard 33: Expected: 0s, Actual: 79s, Diff: 79s
[task 2024-12-17T17:02:03.023Z] Shard 34: Expected: 0s, Actual: 127s, Diff: 127s
[task 2024-12-17T17:02:03.023Z] Shard 35: Expected: 0s, Actual: 45s, Diff: 45s
[task 2024-12-17T17:02:03.023Z] Shard 36: Expected: 0s, Actual: 54s, Diff: 54s
[task 2024-12-17T17:02:03.023Z] Shard 37: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z] Shard 38: Expected: 0s, Actual: 41s, Diff: 41s
[task 2024-12-17T17:02:03.023Z] Shard 39: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.023Z] Shard 40: Expected: 0s, Actual: 35s, Diff: 35s
[task 2024-12-17T17:02:03.023Z] Shard 41: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z] Shard 42: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z] Shard 43: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z] Shard 35: Expected: 0s, Actual: 45s, Diff: 45s
[task 2024-12-17T17:02:03.023Z] Shard 36: Expected: 0s, Actual: 54s, Diff: 54s
[task 2024-12-17T17:02:03.023Z] Shard 37: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z] Shard 38: Expected: 0s, Actual: 41s, Diff: 41s
[task 2024-12-17T17:02:03.023Z] Shard 39: Expected: 0s, Actual: 53s, Diff: 53s
[task 2024-12-17T17:02:03.023Z] Shard 40: Expected: 0s, Actual: 35s, Diff: 35s
[task 2024-12-17T17:02:03.023Z] Shard 41: Expected: 0s, Actual: 26s, Diff: 26s
[task 2024-12-17T17:02:03.023Z] Shard 42: Expected: 0s, Actual: 56s, Diff: 56s
[task 2024-12-17T17:02:03.023Z] Shard 43: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z] Shard 44: Expected: 0s, Actual: 33s, Diff: 33s
[task 2024-12-17T17:02:03.023Z] Shard 45: Expected: 0s, Actual: 20s, Diff: 20s
[task 2024-12-17T17:02:03.023Z] Shard 46: Expected: 0s, Actual: 75s, Diff: 75s
[task 2024-12-17T17:02:03.023Z] Shard 47: Expected: 0s, Actual: 72s, Diff: 72s
[task 2024-12-17T17:02:03.023Z] Shard 48: Expected: 0s, Actual: 27s, Diff: 27s
[task 2024-12-17T17:02:03.023Z] Shard 49: Expected: 0s, Actual: 40s, Diff: 40s
[task 2024-12-17T17:02:03.023Z]
[task 2024-12-17T17:02:03.023Z]
[task 2024-12-17T17:02:03.023Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a.yml --app /builds/worker/checkouts/gecko/mobile/android/focus-android/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-focus-android --client-details matrixLabel=autoland,geckoRev=f9f069f580c6c979fa9eb5d7d079ad86604e35cb --test /builds/worker/checkouts/gecko/mobile/android/focus-android/android-test.apk failed with exit code 10
[task 2024-12-17T17:02:03.064Z] TEST-UNEXPECTED-FAIL | org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest | androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller]
[task 2024-12-17T17:02:03.064Z] at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353)
[task 2024-12-17T17:02:03.064Z] at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336)
[task 2024-12-17T17:02:03.064Z] at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260)
[task 2024-12-17T17:02:03.064Z] at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235)
[task 2024-12-17T17:02:03.064Z] at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28)
[task 2024-12-17T17:02:03.065Z] at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:77)
[task 2024-12-17T17:02:03.065Z] at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:75)
[task 2024-12-17T17:02:03.065Z] at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126)
[task 2024-12-17T17:02:03.065Z] at org.mozilla.focus.activity.DownloadFileTest.downloadNotificationTest(DownloadFileTest.kt:75)
[task 2024-12-17T17:02:03.065Z]
[task 2024-12-17T17:02:03.065Z]
[task 2024-12-17T17:02:03.065Z] ╔═════════════════════════════════════════════════════════════════════════╤═════════╤══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2024-12-17T17:02:03.065Z] ║ UI Test │ Outcome │ Details ║
[task 2024-12-17T17:02:03.065Z] ╟─────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-12-17T17:02:03.065Z] ║ org.mozilla.focus.activity.SwitchContextTest#notificationOpenButtonTest │ Flaky │ androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.SwitchContextTest$setUp$2.invoke(SwitchContextTest.kt:52) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.SwitchContextTest$setUp$2.invoke(SwitchContextTest.kt:50) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.SwitchContextTest.setUp(SwitchContextTest.kt:50) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ ║
[task 2024-12-17T17:02:03.065Z] ╟─────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-12-17T17:02:03.065Z] ║ org.mozilla.focus.activity.DownloadFileTest#downloadNotificationTest │ Failure │ androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:353) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:336) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:260) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at androidx.test.uiautomator.UiScrollable.scrollIntoView(UiScrollable.java:235) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.robots.NotificationRobot.clearNotifications(NotificationRobot.kt:28) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:77) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.DownloadFileTest$downloadNotificationTest$1.invoke(DownloadFileTest.kt:75) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.robots.NotificationRobotKt.notificationTray(NotificationRobot.kt:126) ║
[task 2024-12-17T17:02:03.065Z] ║ │ │ at org.mozilla.focus.activity.DownloadFileTest.downloadNotificationTest(DownloadFileTest.kt:75) ║
[task 2024-12-17T17:02:03.070Z] ║ │ │ ║
[task 2024-12-17T17:02:03.071Z] ║ │ │ ║
[task 2024-12-17T17:02:03.071Z] ╚═════════════════════════════════════════════════════════════════════════╧═════════╧══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2024-12-17T17:02:03.071Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 1
[taskcluster 2024-12-17 17:02:03.625Z] === Task Finished ===
[taskcluster 2024-12-17 17:02:17.162Z] Unsuccessful task run with exit code: 10 completed in 696.108 seconds
Updated•2 months ago
|
Comment 1•2 months ago
|
||
I think Google Play Services 24.45.34 seems unstable here versus 24.43.37 green on other matrices affecting the outcomes of tests that check for com.android.systemui:id/notification_stack_scroller
elements. Unfortunately we have no control on what Firebase team deploys for Google Play Services so we'll need to investigate here if there's any work-around.
See also https://bugzilla.mozilla.org/show_bug.cgi?id=1937820
Assignee | ||
Comment 2•2 months ago
|
||
Updated•2 months ago
|
Comment 4•2 months ago
|
||
bugherder |
Assignee | ||
Comment 5•2 months ago
|
||
5 UI tests started to fail all of a sudden.
The failures were occurring when trying to clear the system notifications before running the UI tests.
As Aaron pointed out these failures might be related to a GPS update (updated to 24.45.34)
Considering that we do the same thing (clear the notifications before running certain test) on Fenix, and that Fenix wasn't affected by the GPS update, I've moved the implementation from Fenix to Focus. (the main change is related to identifying the clearButton)
- All UI tests successfully passed 1x on Firebase ✅ [[ https://treeherder.mozilla.org/jobs?repo=try&selectedTaskRun=CQ5eMoIRR7q5LbFerSW44Q.0&revision=04e8bb64abadce01b32ade313fe215f5b506541f | Try run ]]
- All 5 affected UI tests successfully passed 10x on Firebase ✅ [[ https://treeherder.mozilla.org/jobs?repo=try&selectedTaskRun=IGUkUkDwQJqp3mHKyIxuOw.0&revision=47199eda2a3e625ccfc68012abea292db178c6f1 | Try run ]]
Original Revision: https://phabricator.services.mozilla.com/D232493
Updated•2 months ago
|
Comment 6•2 months ago
|
||
beta Uplift Approval Request
- User impact if declined: None
- Code covered by automated testing: yes
- Fix verified in Nightly: yes
- Needs manual QE test: no
- Steps to reproduce for manual QE testing: None
- Risk associated with taking this patch: None
- Explanation of risk level: None
- String changes made/needed: No
- Is Android affected?: yes
Updated•2 months ago
|
Updated•2 months ago
|
Comment hidden (Intermittent Failures Robot) |
Description
•