1932284 - Perma fenix-debug org.mozilla.fenix.ui.TopSitesTest#openTopSiteInANewTabTest | java.lang.NullPointerException: getHost(...) must not be null

Status: RESOLVED FIXED

(Fenix :: UI Tests, defect)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=483427852&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VHxgZQ_FRiOFt7Y9kFE8Kg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-11-20T03:54:21.999Z] MatrixResultsReport
[task 2024-11-20T03:54:21.999Z]   0 / 1 (0.00%)
[task 2024-11-20T03:54:21.999Z]   1 matrices failed
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] ┌─────────┬──────────────────────┬──────────┬──────────────────┬───────────────────────────────────┬───────────────────────────────┐
[task 2024-11-20T03:54:21.999Z] │ OUTCOME │      MATRIX ID       │ APP NAME │  TEST FILE NAME  │          TEST AXIS VALUE          │         TEST DETAILS          │
[task 2024-11-20T03:54:21.999Z] ├─────────┼──────────────────────┼──────────┼──────────────────┼───────────────────────────────────┼───────────────────────────────┤
[task 2024-11-20T03:54:21.999Z] │ failure │ matrix-3vinhj8d2ufle │ app.apk  │ android-test.apk │ MediumPhone.arm-26-en_US-portrait │ 1 test cases failed, 7 passed │
[task 2024-11-20T03:54:21.999Z] │ failure │ matrix-3vinhj8d2ufle │ app.apk  │ android-test.apk │ MediumPhone.arm-28-en_US-portrait │ 1 test cases failed, 7 passed │
[task 2024-11-20T03:54:21.999Z] │ failure │ matrix-3vinhj8d2ufle │ app.apk  │ android-test.apk │ MediumPhone.arm-30-en_US-portrait │ 1 test cases failed, 7 passed │
[task 2024-11-20T03:54:21.999Z] │ failure │ matrix-3vinhj8d2ufle │ app.apk  │ android-test.apk │ MediumPhone.arm-32-en_US-portrait │ 1 test cases failed, 7 passed │
[task 2024-11-20T03:54:21.999Z] └─────────┴──────────────────────┴──────────┴──────────────────┴───────────────────────────────────┴───────────────────────────────┘
[task 2024-11-20T03:54:21.999Z] More details are available at:
[task 2024-11-20T03:54:21.999Z] https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/4885070562497574493/details
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] Matrices webLink
[task 2024-11-20T03:54:21.999Z]   matrix-3vinhj8d2ufle https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/4885070562497574493/details
[task 2024-11-20T03:54:21.999Z] Actual shard times:
[task 2024-11-20T03:54:21.999Z]   Shard 0: Expected: 0s, Actual: 14s, Diff: 14s
[task 2024-11-20T03:54:21.999Z]   Shard 1: Expected: 0s, Actual: 14s, Diff: 14s
[task 2024-11-20T03:54:21.999Z]   Shard 2: Expected: 0s, Actual: 12s, Diff: 12s
[task 2024-11-20T03:54:21.999Z]   Shard 3: Expected: 0s, Actual: 32s, Diff: 32s
[task 2024-11-20T03:54:21.999Z]   Shard 4: Expected: 0s, Actual: 10s, Diff: 10s
[task 2024-11-20T03:54:21.999Z]   Shard 5: Expected: 0s, Actual: 13s, Diff: 13s
[task 2024-11-20T03:54:21.999Z]   Shard 6: Expected: 0s, Actual: 30s, Diff: 30s
[task 2024-11-20T03:54:21.999Z]   Shard 7: Expected: 0s, Actual: 13s, Diff: 13s
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] 
[task 2024-11-20T03:54:21.999Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm-legacy-api-tests.yml --app /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-fenix --client-details matrixLabel=autoland,geckoRev=ecef33a461c94d867b7657d96ddfe6400e5b6842 --test /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk failed with exit code 10
[task 2024-11-20T03:54:22.042Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.TopSitesTest#openTopSiteInANewTabTest | java.lang.NullPointerException: getHost(...) must not be null
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:115)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:94)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:417)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:94)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.TopSitesTest$openTopSiteInANewTabTest$7.invoke(TopSitesTest.kt:81)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.TopSitesTest$openTopSiteInANewTabTest$7.invoke(TopSitesTest.kt:80)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openTopSiteTabWithTitle(HomeScreenRobot.kt:843)
[task 2024-11-20T03:54:22.042Z]  at org.mozilla.fenix.ui.TopSitesTest.openTopSiteInANewTabTest(TopSitesTest.kt:80)
[task 2024-11-20T03:54:22.042Z] 
[task 2024-11-20T03:54:22.042Z]     
[task 2024-11-20T03:54:22.042Z] ╔════════════════════════════════════════════════════════════╤═════════╤═══════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2024-11-20T03:54:22.042Z] ║ UI Test                                                    │ Outcome │ Details                                                                                                       ║
[task 2024-11-20T03:54:22.042Z] ╟────────────────────────────────────────────────────────────┼─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2024-11-20T03:54:22.042Z] ║ org.mozilla.fenix.ui.TopSitesTest#openTopSiteInANewTabTest │ Failure │ java.lang.NullPointerException: getHost(...) must not be null                                                 ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:115)                          ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyUrl$1.invoke(BrowserRobot.kt:94)                           ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:417) ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyUrl(BrowserRobot.kt:94)                                    ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.TopSitesTest$openTopSiteInANewTabTest$7.invoke(TopSitesTest.kt:81)                   ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.TopSitesTest$openTopSiteInANewTabTest$7.invoke(TopSitesTest.kt:80)                   ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openTopSiteTabWithTitle(HomeScreenRobot.kt:843)    ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │  at org.mozilla.fenix.ui.TopSitesTest.openTopSiteInANewTabTest(TopSitesTest.kt:80)                            ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │                                                                                                               ║
[task 2024-11-20T03:54:22.042Z] ║                                                            │         │                                                                                                               ║
[task 2024-11-20T03:54:22.042Z] ╚════════════════════════════════════════════════════════════╧═════════╧═══════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2024-11-20T03:54:22.042Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 1
[taskcluster 2024-11-20 03:54:22.361Z] === Task Finished ===
[taskcluster 2024-11-20 03:54:31.986Z] Unsuccessful task run with exit code: 10 completed in 1023.937 seconds

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Fenix::UI Tests' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1931406

:b4hand, since you are the author of the regressor, bug 1931406, could you take a look?

For more information, please visit BugBot documentation.

Comment 3

[Intermittent Failures Robot]

26 failures in 922 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 9
• autoland: 17

Platform and build breakdown:

• fenix-android-all: 26
  • opt: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1932284&startday=2024-11-19&endday=2024-11-19&tree=all

Comment 4

[Andrei Jolțan [:Andi]]

Attachment: Bug 1932284 - Revert url verifications in UI tests

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2217bc39709a
Revert url verifications in UI tests r=ohorvath

Comment 6

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/2217bc39709a

Comment 7

[Intermittent Failures Robot]

39 failures in 3002 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 25
• mozilla-central: 13
• try: 1

Platform and build breakdown:

• fenix-android-all: 39
  • opt: 39

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1932284&startday=2024-11-18&endday=2024-11-24&tree=all

Comment 8

[Benjamin Forehand Jr[:b4hand]]

I think this has been cleared up