1863139 - Perma shippable platforms backlog (W-b) [tier 2] /soft-navigation-heuristics/disabled.html | Test that a soft navigation is not detected when the feature is disabled - assert_equals: No LCP entries accumulated expected 2 but got 1

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=434975600&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OzVw5lnBQWqxzV_LjYb8QA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-11-04T11:44:13.620Z] 11:44:13     INFO - TEST-START | /soft-navigation-heuristics/disabled.html
[task 2023-11-04T11:44:13.640Z] 11:44:13     INFO - Closing window 4126beff-7e2f-4d97-b431-479ff6bf5037
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/same-site-cookies.https.html | same-origin, form post with change-request, cross-site redirect, and same-origin redirect 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/same-site-cookies.https.html | Cleanup service workers 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-TIMEOUT | /service-workers/service-worker/unregister-immediately-before-installed.https.html | Clear-Site-Data must abort service worker registration. - Test timed out
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/unregister-immediately-before-installed.https.html | Clear-Site-Data must unregister a registration with a worker in the "installing" state. 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-TIMEOUT | /service-workers/service-worker/unregister-immediately-during-extendable-events.https.html | Clear-Site-Data must fail pending subresource fetch events. - Test timed out
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-TIMEOUT | /service-workers/service-worker/unregister-immediately.https.html | Clear-Site-Data must unregister a registration with a worker in the "activating" state. - Test timed out
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/unregister-immediately.https.html | Clear-Site-Data must unregister an activated registration with an update waiting. 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/unregister-immediately.https.html | Clear-Site-Data must unregister an activated registration with controlled clients. 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-NOTRUN | /service-workers/service-worker/unregister-immediately.https.html | Clear-Site-Data must clear an unregistered registration waiting for  controlled clients to unload. 
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-TIMEOUT | /soft-navigation-heuristics/back.tentative.html | Detect simple soft navigation. - Test timed out
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-UNEXPECTED-FAIL | /soft-navigation-heuristics/disabled.html | Test that a soft navigation is not detected when the feature is disabled - assert_equals: No LCP entries accumulated expected 2 but got 1
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - testSoftNavigationNotDetected/<@http://web-platform.test:8000/soft-navigation-heuristics/resources/soft-navigation-helper.js:95:20
[task 2023-11-04T11:44:14.387Z] 11:44:14     INFO - TEST-INFO | expected TIMEOUT
[task 2023-11-04T11:44:14.463Z] 11:44:14     INFO - TEST-UNEXPECTED-OK | /soft-navigation-heuristics/disabled.html | expected TIMEOUT
[task 2023-11-04T11:44:14.463Z] 11:44:14     INFO - TEST-INFO expected TIMEOUT | took 844ms
[task 2023-11-04T11:44:14.796Z] 11:44:14     INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2023-11-04T11:44:14.899Z] 11:44:14     INFO - Closing logging queue
[task 2023-11-04T11:44:14.899Z] 11:44:14     INFO - queue closed
[task 2023-11-04T11:44:14.900Z] 11:44:14     INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2023-11-04T11:44:14.911Z] 11:44:14     INFO - Setting up ssl
[task 2023-11-04T11:44:14.931Z] 11:44:14     INFO - certutil | b''
[task 2023-11-04T11:44:14.950Z] 11:44:14     INFO - certutil | b''
[task 2023-11-04T11:44:14.962Z] 11:44:14     INFO - certutil | b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
[task 2023-11-04T11:44:15.578Z] 11:44:15     INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test_runner
[task 2023-11-04T11:44:16.639Z] 11:44:16     INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmpnzqjb2ubpidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
[task 2023-11-04T11:44:17.850Z] 11:44:17     INFO - Starting runner
[task 2023-11-04T11:44:18.655Z] 11:44:18     INFO - TEST-START | /soft-navigation-heuristics/dropped-entries.tentative.html

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1722322

:sefeng, since you are the author of the regressor, bug 1722322, could you take a look?

For more information, please visit BugBot documentation.

Comment 2

[Iulian Moraru]

On Linux, Windows and OSX this failure line doesn't show up in treeherder because of spam lines which are Bug 1861916, example.

Comment 3

[Intermittent Failures Robot]

24 failures in 3356 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 24

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 10
  • opt: 10
• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4
• linux1804-64-shippable-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 3
  • opt: 3
• windows11-64-2009-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1863139&startday=2023-10-30&endday=2023-11-05&tree=all

Comment 4

[Sean Feng [:sefeng]]

I am fixing this in bug 1862966

Comment 5

[Cristian Tuns]

It looks like it is not fixed in bug 1862966 we still have it on central after the patch. Can you please take another look?

Comment 6

[Sean Feng [:sefeng]]

Sorry, my bad! Looking

Comment 7

[Sean Feng [:sefeng]]

Attachment: Bug 1863139 - Fix the Perma failure for soft-navigation-heuristics/disabled.html r=emilio

The test ensures LCP doesn't expose the state of soft-navigation. Since
this is something that we don't support, I think it's okay to not bother
with it.

Comment 8

[Intermittent Failures Robot]

20 failures in 552 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 20

Platform and build breakdown:

• macosx1015-64-shippable-qr: 7
  • opt: 7
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3
• windows11-64-2009-shippable-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1863139&startday=2023-11-07&endday=2023-11-07&tree=all

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/09e8f6f46e4d
Fix the Perma failure for soft-navigation-heuristics/disabled.html r=emilio

Comment 10

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/09e8f6f46e4d

Comment 11

[Intermittent Failures Robot]

25 failures in 3288 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 25

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4
• windows11-64-2009-shippable-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 8
  • opt: 8
• linux1804-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1863139&startday=2023-11-06&endday=2023-11-12&tree=all