1898750 - Perma Late Beta TEST-UNEXPECTED-FAIL | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | Uncaught exception in test bound - undefined - when Gecko 128 switches from Early Beta to Late Beta on 2024-06-21

Status: VERIFIED FIXED

(DevTools :: General, defect)

Description

[pstanciu]

Central-as-beta-simulation

How to run these simulations

Failure log

[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected ServerTimings flag - 
[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - Buffered messages logged at 11:45:36
[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - Console message: [JavaScript Error: "TypeError: NetworkError when attempting to fetch resource."]
[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - Enable the auth prompt listener for this network observer
[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - Wait for all network events to be received
[task 2024-05-24T11:45:43.149Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | Received the expected number of network events - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | The auth prompt was handled by the network event owner - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected ResponseStart flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected EventTimings flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected AuthPrompt flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected ResponseCache flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected ResponseContent flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected SecurityInfo flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-PASS | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | network event has the expected ServerTimings flag - 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Leaving test bound 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Entering test bound 
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Buffered messages logged at 11:45:37
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Console message: [JavaScript Error: "TypeError: NetworkError when attempting to fetch resource."]
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Enable the auth prompt listener for this network observer
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Wait for all network events to be received
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Buffered messages finished
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - TEST-UNEXPECTED-FAIL | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | Uncaught exception in test bound  - undefined - timed out after 50 tries.
[task 2024-05-24T11:45:43.150Z] 11:45:43     INFO - Leaving test bound 
[task 2024-05-24T11:45:43.391Z] 11:45:43     INFO - GECKO(7531) | MEMORY STAT | vsize 120590904MB | residentFast 1370MB
[task 2024-05-24T11:45:43.393Z] 11:45:43     INFO - TEST-OK | devtools/shared/network-observer/test/browser/browser_networkobserver_auth_listener.js | took 17029ms
[task 2024-05-24T11:45:43.475Z] 11:45:43     INFO - checking window state
[task 2024-05-24T11:45:43.554Z] 11:45:43     INFO - TEST-START | devtools/shared/network-observer/test/browser/browser_networkobserver_invalid_constructor.js
[task 2024-05-24T11:45:43.977Z] 11:45:43     INFO - GECKO(7531) | MEMORY STAT | vsize 120590907MB | residentFast 1057MB
[task 2024-05-24T11:45:43.979Z] 11:45:43     INFO - TEST-OK | devtools/shared/network-observer/test/browser/browser_networkobserver_invalid_constructor.js | took 425ms
[task 2024-05-24T11:45:44.069Z] 11:45:44     INFO - checking window state
[task 2024-05-24T11:45:44.137Z] 11:45:44     INFO - TEST-START | devtools/shared/network-observer/test/browser/browser_networkobserver_override.js

Comment 1

[Julian Descottes [:jdescottes]]

Not sure what causes the issue, but this is related to Bug 1880803 which was since then backed out, so the title should mention Gecko 128 and not Gecko 127?

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Thanks for catching this

Comment 3

[Julian Descottes [:jdescottes]]

So there is a JS error in the middle of the test, but it's weird that I don't have the same failure locally.
When something auth related fails on late beta it's usually been because of network.auth.use_redirect_for_retries.

Anyway fixing the error in the test seems to make the permafail disappear: https://treeherder.mozilla.org/jobs?repo=try&revision=9786bcea621379a81c6580fa48940ec1f88d299a

I will fold that into Bug 1880803, we can close this bug once we verified it's fixed.

Comment 4

[Intermittent Failures Robot]

2 failures in 3995 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1898750&startday=2024-05-20&endday=2024-05-26&tree=all

Comment 5

[Julian Descottes [:jdescottes]]

Bug 1880803 landed again, the next late beta sim should hopefully no longer have this bug.

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The issue can still be observed with today's late beta simulation (please ignore the version number, it should be 128.0b12).

Comment 7

[Julian Descottes [:jdescottes]]

Attachment: Bug 1898750 - [devtools] Force network.auth.use_redirect_for_retries in auth listener test

I will investigate this in a follow up, but the auth listener is not used in production code by devtools.
It is only used in BiDi with early events, which does not seem to fail on late beta.

Comment 8

[Julian Descottes [:jdescottes]]

(In reply to Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout) from comment #6)

The issue can still be observed with today's late beta simulation (please ignore the version number, it should be 128.0b12).

Thanks for the heads up. This time I can reproduce locally when setting the network.auth.use_redirect_for_retries preference, not sure why I didn't manage to do it previously. Not fully clear why this causes an issue here, but the failing configuration is not currently used in production code, so I will investigate it in a follow up.

Comment 9

[Intermittent Failures Robot]

1 failures in 4202 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• macosx1015-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1898750&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ac7ea322bb65
[devtools] Force network.auth.use_redirect_for_retries in auth listener test r=devtools-reviewers,nchevobbe

Comment 11

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/ac7ea322bb65

Comment 12

[Iulian Moraru]

Fix verified in today's central as late beta simulation.