Closed Bug 1948492 Opened 5 days ago Closed 3 days ago

Perma [tier 2] org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#httpsOnlyModeEnabledOnlyInPrivateBrowsingTest | java.lang.AssertionError

Categories

(Fenix :: UI Tests, defect, P5)

All
Android
defect

Tracking

(firefox135 unaffected, firefox136 fixed, firefox137 fixed)

RESOLVED FIXED
137 Branch
Tracking Status
firefox135 --- unaffected
firefox136 --- fixed
firefox137 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ohorvath)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(2 files)

Filed by: amarc [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=495139089&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EDsv-1HZTme1bqAqgeoRtg/runs/0/artifacts/public/logs/live_backing.log


[task 2025-02-15T16:39:46.340Z] 
[task 2025-02-15T16:39:46.340Z] 
[task 2025-02-15T16:39:46.340Z] Command /usr/bin/java -jar /builds/worker/test-tools/flank.jar android run --config ./automation/taskcluster/androidTest/flank-arm64-v8a.yml --app /builds/worker/checkouts/gecko/mobile/android/fenix/app.apk --local-result-dir /builds/worker/artifacts/results --project moz-fenix --client-details matrixLabel=mozilla-beta,geckoRev=4c3ef8568135218a644d4b805106680c625f0608 --test /builds/worker/checkouts/gecko/mobile/android/fenix/android-test.apk failed with exit code 10
[task 2025-02-15T16:39:46.391Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#turnOffHttpsOnlyModeTest | java.lang.AssertionError
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.fail(Assert.java:87)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:53)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$turnOffHttpsOnlyModeTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:192)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$turnOffHttpsOnlyModeTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:186)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.turnOffHttpsOnlyModeTest(SettingsHTTPSOnlyModeTest.kt:186)
[task 2025-02-15T16:39:46.392Z] 
[task 2025-02-15T16:39:46.392Z]     
[task 2025-02-15T16:39:46.392Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#httpsOnlyModeEnabledOnlyInPrivateBrowsingTest | java.lang.AssertionError
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.fail(Assert.java:87)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:53)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledOnlyInPrivateBrowsingTest$12.invoke(SettingsHTTPSOnlyModeTest.kt:163)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledOnlyInPrivateBrowsingTest$12.invoke(SettingsHTTPSOnlyModeTest.kt:157)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledOnlyInPrivateBrowsingTest(SettingsHTTPSOnlyModeTest.kt:157)
[task 2025-02-15T16:39:46.392Z] 
[task 2025-02-15T16:39:46.392Z]     
[task 2025-02-15T16:39:46.392Z] TEST-UNEXPECTED-FAIL | org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#httpsOnlyModeEnabledInNormalBrowsingTest | java.lang.AssertionError
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.fail(Assert.java:87)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:42)
[task 2025-02-15T16:39:46.392Z]  at org.junit.Assert.assertTrue(Assert.java:53)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$9.invoke(SettingsHTTPSOnlyModeTest.kt:95)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$9.invoke(SettingsHTTPSOnlyModeTest.kt:89)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)
[task 2025-02-15T16:39:46.392Z]  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest(SettingsHTTPSOnlyModeTest.kt:89)
[task 2025-02-15T16:39:46.392Z] 
[task 2025-02-15T16:39:46.392Z]     
[task 2025-02-15T16:39:46.392Z] ╔══════════════════════════════════════════════════════════════════════════════════════════════╤═════════╤══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╗
[task 2025-02-15T16:39:46.392Z] ║ UI Test                                                                                      │ Outcome │ Details                                                                                                                                      ║
[task 2025-02-15T16:39:46.392Z] ╟──────────────────────────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-15T16:39:46.392Z] ║ org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#turnOffHttpsOnlyModeTest                      │ Failure │ java.lang.AssertionError                                                                                                                     ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.fail(Assert.java:87)                                                                                                    ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:42)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:53)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)                                ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)                                                          ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$turnOffHttpsOnlyModeTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:192)                       ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$turnOffHttpsOnlyModeTest$8.invoke(SettingsHTTPSOnlyModeTest.kt:186)                       ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)                   ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.turnOffHttpsOnlyModeTest(SettingsHTTPSOnlyModeTest.kt:186)                                ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ╟──────────────────────────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-15T16:39:46.392Z] ║ org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#httpsOnlyModeEnabledOnlyInPrivateBrowsingTest │ Failure │ java.lang.AssertionError                                                                                                                     ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.fail(Assert.java:87)                                                                                                    ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:42)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:53)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)                                ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)                                                          ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledOnlyInPrivateBrowsingTest$12.invoke(SettingsHTTPSOnlyModeTest.kt:163) ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledOnlyInPrivateBrowsingTest$12.invoke(SettingsHTTPSOnlyModeTest.kt:157) ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)                   ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledOnlyInPrivateBrowsingTest(SettingsHTTPSOnlyModeTest.kt:157)           ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ╟──────────────────────────────────────────────────────────────────────────────────────────────┼─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╢
[task 2025-02-15T16:39:46.392Z] ║ org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest#httpsOnlyModeEnabledInNormalBrowsingTest      │ Failure │ java.lang.AssertionError                                                                                                                     ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.fail(Assert.java:87)                                                                                                    ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:42)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.junit.Assert.assertTrue(Assert.java:53)                                                                                              ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:195)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot$verifyPageContent$1.invoke(BrowserRobot.kt:194)                                                 ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.helpers.AppAndSystemHelper.registerAndCleanupIdlingResources(AppAndSystemHelper.kt:422)                                ║
[task 2025-02-15T16:39:46.392Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:194)                                                          ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$9.invoke(SettingsHTTPSOnlyModeTest.kt:95)        ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest$httpsOnlyModeEnabledInNormalBrowsingTest$9.invoke(SettingsHTTPSOnlyModeTest.kt:89)        ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:326)                   ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │  at org.mozilla.fenix.ui.SettingsHTTPSOnlyModeTest.httpsOnlyModeEnabledInNormalBrowsingTest(SettingsHTTPSOnlyModeTest.kt:89)                 ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.399Z] ║                                                                                              │         │                                                                                                                                              ║
[task 2025-02-15T16:39:46.399Z] ╚══════════════════════════════════════════════════════════════════════════════════════════════╧═════════╧══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╝
[task 2025-02-15T16:39:46.399Z] Command ./automation/taskcluster/androidTest/parse-ui-test-fromfile.py --results /builds/worker/artifacts/results failed with exit code 3
[taskcluster 2025-02-15 16:39:46.730Z] === Task Finished ===
[taskcluster 2025-02-15 16:40:08.997Z] Unsuccessful task run with exit code: 10 completed in 772.806 seconds

Keywords: regression
Regressed by: 1948000

The Bugbug bot thinks this bug should belong to the 'Fenix::UI Tests' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Component: General → UI Tests

Set release status flags based on info from the regressing bug 1948000

:ohorvath, since you are the author of the regressor, bug 1948000, could you take a look?

For more information, please visit BugBot documentation.

Flags: needinfo?(ohorvath)
Assignee: nobody → ohorvath
Status: NEW → ASSIGNED
Attachment #9466619 - Flags: approval-mozilla-beta?

In https://phabricator.services.mozilla.com/D238191 I've removed a workaround for a Fission bug that was fixed in the meantime. However, I was unaware my fix would be uplifted to Beta, where the other fix had not landed yet.
This will re-apply the workaround until the next cycle.

Original Revision: https://phabricator.services.mozilla.com/D238476

Attachment #9466649 - Flags: approval-mozilla-beta?
Status: ASSIGNED → RESOLVED
Closed: 3 days ago
Flags: needinfo?(ohorvath)
Resolution: --- → FIXED
Attachment #9466649 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
Attachment #9466619 - Flags: approval-mozilla-beta?
Pushed by sstanca@mozilla.com: https://hg.mozilla.org/mozilla-central/rev/fe4c38b27f36 Re-apply workaround for Bug 1932498 in UI tests failing on Beta r=ajoltan DONTBUILD
Target Milestone: --- → 137 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: