Closed
Bug 1892523
Opened 2 years ago
Closed 2 years ago
Perma [tier 2] org.mozilla.fenix.ui.PocketTest#openPocketStoryItemTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=utm_source=pocket-newtab-android, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] does not exist
Categories
(Firefox for Android :: General, defect, P5)
Tracking
()
RESOLVED
DUPLICATE
of bug 1868291
People
(Reporter: intermittent-bug-filer, Unassigned)
References
(Regression)
Details
(Keywords: intermittent-failure, regression)
Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=455212135&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KpVBiQ57TbWa_W8VrBFT9A/runs/0/artifacts/public/logs/live_backing.log
[task 2024-04-19T20:16:55.985Z] 14600K .......... .......... .. 100% 298M=0.2s
[task 2024-04-19T20:16:55.985Z]
[task 2024-04-19T20:16:55.985Z] 2024-04-19 20:16:55 (85.3 MB/s) - 'android-test.apk' saved [14973059/14973059]
[task 2024-04-19T20:16:55.985Z]
[task 2024-04-19T20:16:55.986Z] + python3 ../../../taskcluster/scripts/tests/test-lab.py arm64-v8a app.apk --apk_test android-test.apk
[task 2024-04-19T20:16:57.236Z] WARNING: You do not appear to have access to project [moz-fenix] or it does not exist.
[task 2024-04-19T20:16:57.236Z] Updated property [core/project].
[task 2024-04-19T20:16:57.895Z] Activated service account credentials for: [moz-fenix@appspot.gserviceaccount.com]
[task 2024-04-19T20:16:58.296Z] version: v21.08.1
[task 2024-04-19T20:16:58.296Z] revision: ae7539c59a6f2024a43e7e7b51a2cea7bb833adb
[task 2024-04-19T20:16:58.296Z] session id: e665ed71-f78b-423e-b70b-2a440f582287
[task 2024-04-19T20:16:58.296Z]
[task 2024-04-19T20:16:58.296Z]
[task 2024-04-19T20:16:58.296Z] Total run duration: 0m 0s
[task 2024-04-19T20:27:36.879Z] version: v21.08.1
[task 2024-04-19T20:27:36.879Z] revision: ae7539c59a6f2024a43e7e7b51a2cea7bb833adb
[task 2024-04-19T20:27:36.879Z] session id: 67ee3fec-30cd-49e7-b39e-77fbe1b188b3
[task 2024-04-19T20:27:36.879Z]
[task 2024-04-19T20:27:36.879Z] AndroidArgs
[task 2024-04-19T20:27:36.880Z] gcloud:
[task 2024-04-19T20:27:36.880Z] results-bucket: fenix_test_artifacts
[task 2024-04-19T20:27:36.880Z] results-dir: 2024-04-19_20-16-59.674972_CCxS
[task 2024-04-19T20:27:36.880Z] record-video: true
[task 2024-04-19T20:27:36.880Z] timeout: 15m
[task 2024-04-19T20:27:36.880Z] async: false
[task 2024-04-19T20:27:36.880Z] client-details:
[task 2024-04-19T20:27:36.880Z] matrixLabel: autoland
[task 2024-04-19T20:27:36.880Z] network-profile: null
[task 2024-04-19T20:27:36.880Z] results-history-name: null
[task 2024-04-19T20:27:36.880Z] # Android gcloud
[task 2024-04-19T20:27:36.880Z] app: /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk
[task 2024-04-19T20:27:36.880Z] test: /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk
[task 2024-04-19T20:27:36.880Z] additional-apks:
[task 2024-04-19T20:27:36.880Z] auto-google-login: false
[task 2024-04-19T20:27:36.880Z] use-orchestrator: true
[task 2024-04-19T20:27:36.880Z] directories-to-pull:
[task 2024-04-19T20:27:36.880Z] - /sdcard/screenshots
[task 2024-04-19T20:27:36.880Z] grant-permissions: all
[task 2024-04-19T20:27:36.880Z] type: null
[task 2024-04-19T20:27:36.880Z] other-files:
[task 2024-04-19T20:27:36.880Z] scenario-numbers:
[task 2024-04-19T20:27:36.880Z] scenario-labels:
[task 2024-04-19T20:27:36.880Z] obb-files:
[task 2024-04-19T20:27:36.880Z] obb-names:
[task 2024-04-19T20:27:36.880Z] performance-metrics: true
[task 2024-04-19T20:27:36.880Z] num-uniform-shards: null
[task 2024-04-19T20:27:36.880Z] test-runner-class: null
[task 2024-04-19T20:27:36.880Z] test-targets:
[task 2024-04-19T20:27:36.880Z] - notPackage org.mozilla.fenix.screenshots
[task 2024-04-19T20:27:36.880Z] - notPackage org.mozilla.fenix.syncintegration
[task 2024-04-19T20:27:36.880Z] - notPackage org.mozilla.fenix.experimentintegration
[task 2024-04-19T20:27:36.880Z] robo-directives:
[task 2024-04-19T20:27:36.880Z] robo-script: null
[task 2024-04-19T20:27:36.880Z] device:
[task 2024-04-19T20:27:36.880Z] - model: Pixel2.arm
[task 2024-04-19T20:27:36.880Z] version: 30
[task 2024-04-19T20:27:36.880Z] locale: en_US
[task 2024-04-19T20:27:36.880Z] orientation: portrait
[task 2024-04-19T20:27:36.880Z] num-flaky-test-attempts: 1
[task 2024-04-19T20:27:36.880Z] test-targets-for-shard:
[task 2024-04-19T20:27:36.880Z] fail-fast: false
[task 2024-04-19T20:27:36.880Z] parameterized-tests: default
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] flank:
[task 2024-04-19T20:27:36.880Z] max-test-shards: 100
[task 2024-04-19T20:27:36.880Z] shard-time: -1
[task 2024-04-19T20:27:36.880Z] num-test-runs: 1
[task 2024-04-19T20:27:36.880Z] smart-flank-gcs-path:
[task 2024-04-19T20:27:36.880Z] smart-flank-disable-upload: false
[task 2024-04-19T20:27:36.880Z] default-test-time: 120.0
[task 2024-04-19T20:27:36.880Z] use-average-test-time-for-new-tests: false
[task 2024-04-19T20:27:36.880Z] files-to-download:
[task 2024-04-19T20:27:36.880Z] test-targets-always-run:
[task 2024-04-19T20:27:36.880Z] disable-sharding: false
[task 2024-04-19T20:27:36.880Z] project: moz-fenix
[task 2024-04-19T20:27:36.880Z] local-result-dir: /builds/worker/artifacts/results
[task 2024-04-19T20:27:36.880Z] full-junit-result: true
[task 2024-04-19T20:27:36.880Z] # Android Flank Yml
[task 2024-04-19T20:27:36.880Z] keep-file-path: false
[task 2024-04-19T20:27:36.880Z] additional-app-test-apks:
[task 2024-04-19T20:27:36.880Z] run-timeout: -1
[task 2024-04-19T20:27:36.880Z] legacy-junit-result: false
[task 2024-04-19T20:27:36.880Z] ignore-failed-tests: false
[task 2024-04-19T20:27:36.880Z] output-style: compact
[task 2024-04-19T20:27:36.880Z] disable-results-upload: false
[task 2024-04-19T20:27:36.880Z] default-class-test-time: 240.0
[task 2024-04-19T20:27:36.880Z] disable-usage-statistics: false
[task 2024-04-19T20:27:36.880Z] output-report: none
[task 2024-04-19T20:27:36.880Z] skip-config-validation: false
[task 2024-04-19T20:27:36.880Z] custom-sharding-json:
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] RunTests
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] Smart Flank cache hit: 0% (0 / 590)
[task 2024-04-19T20:27:36.880Z] Shard times: 600s, 600s, 600s, 600s, 600s, 600s, 600s, 600s, 600s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s, 720s
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] 589 tests + 1 parameterized class / 100 shards
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] 1 matrix ids created in 0m 12s
[task 2024-04-19T20:27:36.880Z] Raw results will be stored in your GCS bucket at [https://console.developers.google.com/storage/browser/fenix_test_artifacts/2024-04-19_20-16-59.674972_CCxS]
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] Matrices webLink
[task 2024-04-19T20:27:36.880Z] matrix-34is4gfi8f9z1 https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/5256420215320263077
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] 10m 8s matrix-34is4gfi8f9z1 FINISHED
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] CostReport
[task 2024-04-19T20:27:36.880Z] Virtual devices
[task 2024-04-19T20:27:36.880Z] $5.25 for 5h 15m
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] MatrixResultsReport
[task 2024-04-19T20:27:36.880Z] 0 / 1 (0.00%)
[task 2024-04-19T20:27:36.880Z] 1 matrices failed
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
[task 2024-04-19T20:27:36.880Z] ? OUTCOME ? MATRIX ID ? APP NAME ? TEST FILE NAME ? TEST AXIS VALUE ? TEST DETAILS ?
[task 2024-04-19T20:27:36.880Z] ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
[task 2024-04-19T20:27:36.880Z] ? failure ? matrix-34is4gfi8f9z1 ? app.apk ? android-test.apk ? Pixel2.arm-30-en_US-portrait ? 1 test cases failed, 596 passed, 1 flaky ?
[task 2024-04-19T20:27:36.880Z] ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
[task 2024-04-19T20:27:36.880Z] More details are available at:
[task 2024-04-19T20:27:36.880Z] https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/5256420215320263077
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z]
[task 2024-04-19T20:27:36.880Z] Matrices webLink
[task 2024-04-19T20:27:36.880Z] matrix-34is4gfi8f9z1 https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/5256420215320263077
[task 2024-04-19T20:27:36.880Z] Actual shard times:
[task 2024-04-19T20:27:36.880Z] Shard 0: Expected: 0s, Actual: 70s, Diff: 70s
<...>
[task 2024-04-19T20:27:37.035Z] Shard 98: Expected: 0s, Actual: 231s, Diff: 231s
[task 2024-04-19T20:27:37.035Z] Shard 99: Expected: 0s, Actual: 100s, Diff: 100s
[task 2024-04-19T20:27:37.035Z]
[task 2024-04-19T20:27:37.035Z]
[task 2024-04-19T20:27:37.035Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a.yml --app /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-fenix --client-details matrixLabel=autoland --test /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk failed with exit code 10
[task 2024-04-19T20:27:37.081Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.PocketTest#openPocketStoryItemTest | java.lang.AssertionError: UiSelector[CONTAINS_TEXT=utm_source=pocket-newtab-android, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] does not exist
[task 2024-04-19T20:27:37.081Z] at org.junit.Assert.fail(Assert.java:89)
[task 2024-04-19T20:27:37.081Z] at org.junit.Assert.assertTrue(Assert.java:42)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:84)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:83)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:383)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:83)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.PocketTest$openPocketStoryItemTest$3.invoke(PocketTest.kt:78)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.PocketTest$openPocketStoryItemTest$3.invoke(PocketTest.kt:77)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.clickPocketStoryItem(HomeScreenRobot.kt:1029)
[task 2024-04-19T20:27:37.081Z] at org.mozilla.fenix.ui.PocketTest.openPocketStoryItemTest(PocketTest.kt:77)
[task 2024-04-19T20:27:37.081Z]
[task 2024-04-19T20:27:37.081Z]
[task 2024-04-19T20:27:37.081Z] ╔═════════════════════════════════════════════════════════════════════════════════════╤═════════╤══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2024-04-19T20:27:37.081Z] ║ UI Test │ Outcome │ Details ║
[task 2024-04-19T20:27:37.081Z] ╟─────────────────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-04-19T20:27:37.081Z] ║ org.mozilla.fenix.ui.EnhancedTrackingProtectionTest#customizedTrackingProtectionOpt │ Flaky │ java.lang.AssertionError: UiSelector[RESOURCE_ID=org.mozilla.fenix.debug:id/cryptominers] does not exist ║
[task 2024-04-19T20:27:37.081Z] ║ ionsTest │ │ ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.junit.Assert.fail(Assert.java:89) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.junit.Assert.assertTrue(Assert.java:42) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.ui.robots.EnhancedTrackingProtectionRobot.verifyCryptominersBlocked(EnhancedTrackingProtectionRobot.kt:141) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest$customizedTrackingProtectionOptionsTest$12.invoke(EnhancedTrackingProtectionTest.kt:385) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest$customizedTrackingProtectionOptionsTest$12.invoke(EnhancedTrackingProtectionTest.kt:382) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.ui.robots.EnhancedTrackingProtectionRobot$Transition.openDetails(EnhancedTrackingProtectionRobot.kt:279) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest.customizedTrackingProtectionOptionsTest(EnhancedTrackingProtectionTest.kt:382) ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ ║
[task 2024-04-19T20:27:37.081Z] ╟─────────────────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-04-19T20:27:37.081Z] ║ org.mozilla.fenix.ui.PocketTest#openPocketStoryItemTest │ Failure │ java.lang.AssertionError: UiSelector[CONTAINS_TEXT=utm_source=pocket-newtab-android, RESOURCE_ID=org.mozilla.fenix.debug:id/mozac_browser_toolbar_url_view] ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ does not exist ║
[task 2024-04-19T20:27:37.081Z] ║ │ │ at org.junit.Assert.fail(Assert.java:89) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.junit.Assert.assertTrue(Assert.java:42) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:100) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:84) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:83) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:383) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:83) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.PocketTest$openPocketStoryItemTest$3.invoke(PocketTest.kt:78) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.PocketTest$openPocketStoryItemTest$3.invoke(PocketTest.kt:77) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.clickPocketStoryItem(HomeScreenRobot.kt:1029) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ at org.mozilla.fenix.ui.PocketTest.openPocketStoryItemTest(PocketTest.kt:77) ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ ║
[task 2024-04-19T20:27:37.087Z] ║ │ │ ║
[task 2024-04-19T20:27:37.087Z] ╚═════════════════════════════════════════════════════════════════════════════════════╧═════════╧══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2024-04-19T20:27:37.087Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 1
[taskcluster 2024-04-19 20:27:37.334Z] === Task Finished ===
[taskcluster 2024-04-19 20:27:59.754Z] Unsuccessful task run with exit code: 10 completed in 863.716 seconds
|
||
Comment 1•2 years ago
|
||
diff to disable temporarily https://phabricator.services.mozilla.com/D208040
The gist is the Pocket page being opened has a DRM prompt blocking the URL-bar URL check.
You need to log in
before you can comment on or make changes to this bug.
Description
•