1861923 - Perma msix netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 198] check number of 200 responses - 4 == 3

Status: RESOLVED DUPLICATE of bug 1866777

(Core :: Networking, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=434213949&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/axBlRvmKQbqhxG7FMXyG1w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-10-30T07:21:50.354Z] 07:21:50     INFO -  TEST-START | netwerk/test/unit/test_race_cache_with_network.js
[task 2023-10-30T07:21:51.158Z] 07:21:51  WARNING -  TEST-UNEXPECTED-FAIL | netwerk/test/unit/test_race_cache_with_network.js | xpcshell return code: 0
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  TEST-INFO took 789ms
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  >>>>>>>
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  running event loop
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.159Z] 07:21:51     INFO -  "isRacing: false
[task 2023-10-30T07:21:51.160Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.160Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.160Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 114] 1 == 1
[task 2023-10-30T07:21:51.161Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 115] check number of 200 responses - 1 == 1
[task 2023-10-30T07:21:51.161Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 116] check number of 304 responses - 0 == 0
[task 2023-10-30T07:21:51.161Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.161Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.161Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.162Z] 07:21:51     INFO -  "isRacing: false
[task 2023-10-30T07:21:51.162Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.162Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.162Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 122] 2 == 2
[task 2023-10-30T07:21:51.162Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 123] check number of 200 responses - 1 == 1
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 124] check number of 304 responses - 1 == 1
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  "isRacing: false
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.163Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.164Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 134] Check that timer works properly - 202 >= 200
[task 2023-10-30T07:21:51.164Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 139] 3 == 3
[task 2023-10-30T07:21:51.164Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 140] check number of 200 responses - 1 == 1
[task 2023-10-30T07:21:51.164Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 141] check number of 304 responses - 2 == 2
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  "isRacing: false
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.165Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 155] 4 == 4
[task 2023-10-30T07:21:51.166Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 156] check number of 200 responses - 1 == 1
[task 2023-10-30T07:21:51.166Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 157] check number of 304 responses - 3 == 3
[task 2023-10-30T07:21:51.166Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.166Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  "isRacing: true
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 168] 5 == 5
[task 2023-10-30T07:21:51.167Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 169] check number of 200 responses - 2 == 2
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 170] check number of 304 responses - 3 == 3
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  "isRacing: true
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.168Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.169Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 182] 6 == 6
[task 2023-10-30T07:21:51.169Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 183] check number of 200 responses - 3 == 3
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 184] check number of 304 responses - 3 == 3
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | undefined assertion name - 8 == 8
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | checkContent - [checkContent : 61] "blahblah" == "blahblah"
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  "isRacing: false
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  "
[task 2023-10-30T07:21:51.170Z] 07:21:51     INFO -  (xpcshell/head.js) | test pending (2)
[task 2023-10-30T07:21:51.171Z] 07:21:51     INFO -  TEST-PASS | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 197] 7 == 7
[task 2023-10-30T07:21:51.171Z] 07:21:51  WARNING -  TEST-UNEXPECTED-FAIL | netwerk/test/unit/test_race_cache_with_network.js | testSteps - [testSteps : 198] check number of 200 responses - 4 == 3
[task 2023-10-30T07:21:51.171Z] 07:21:51     INFO -  Z:/task_169864881952142/build/tests/xpcshell/tests/netwerk/test/unit/test_race_cache_with_network.js:testSteps:198
[task 2023-10-30T07:21:51.171Z] 07:21:51     INFO -  Z:/task_169864881952142/build/tests/xpcshell/tests/netwerk/test/unit/test_race_cache_with_network.js:checkContent/<:72
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  Z:\task_169864881952142\build\tests\xpcshell\head.js:run:804
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  Z:\task_169864881952142\build\tests\xpcshell\head.js:_do_main:245
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  Z:\task_169864881952142\build\tests\xpcshell\head.js:_execute_test:592
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  -e:null:1
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  exiting test
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  (xpcshell/head.js) | test finished (2)
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  "Force a GC"
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  PID 9080 | !!! error running onStopped callback: TypeError: callback is not a function
[task 2023-10-30T07:21:51.172Z] 07:21:51     INFO -  <<<<<<<
[task 2023-10-30T07:21:51.173Z] 07:21:51     INFO -  TEST-START | dom/push/test/xpcshell/test_unregister_invalid_json.js

Comment 1

[Cristian Tuns]

It appeared on this merge: https://treeherder.mozilla.org/jobs?repo=mozilla-central&group_state=expanded&searchStr=windows%2C11%2Cx64%2C22h2%2Cwebrender%2Cshippable%2Copt%2Cxpcshell%2Ctests%2Con%2Cmsix%2Cpackages%2Ctest-windows11-64-2009-shippable-qr%2Fopt-xpcshell-msix%2Cx&revision=61e57e6ba3b7e09a71062e7cdc44f395af832716&selectedTaskRun=a5OsjHW_QJ-WyUyNw95P_Q.0 , and when adding the job on autoland it doesn't look very good. https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&tochange=61e57e6ba3b7e09a71062e7cdc44f395af832716&fromchange=c9e0d0b12d43ba76341d4f0fdd4b3ddec59bd8d6&searchStr=windows%2C11%2Cx64%2C22h2%2Cwebrender%2Cshippable%2Copt%2Cxpcshell%2Ctests%2Con%2Cmsix%2Cpackages%2Ctest-windows11-64-2009-shippable-qr%2Fopt-xpcshell-msix%2Cx&selectedTaskRun=akBz6GvbQP28-PIkPTxnPg.0

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

This fails permanently with Windows .msix Firefox builds, even if the task gets added to pushes where it succeeded before. Any idea what's going on?

Comment 3

[Intermittent Failures Robot]

24 failures in 3356 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 15
• try: 1
• mozilla-esr115: 4
• autoland: 4

Platform and build breakdown:

• windows11-64-2009-shippable-qr: 15
  • opt: 15
• windows10-64-2009-shippable-qr: 5
  • opt: 5
• windows10-64-2009-qr: 2
  • opt: 2
• windows11-64-2009-qr: 1
  • opt: 1
• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1861923&startday=2023-10-30&endday=2023-11-05&tree=all

Comment 4

[Valentin Gosu [:valentin]]

(In reply to Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout) from comment #2)

This fails permanently with Windows .msix Firefox builds, even if the task gets added to pushes where it succeeded before. Any idea what's going on?

I think that means bug 1818757 didn't actually fix it 🙁.
I'll give it another look.

Comment 6

[Intermittent Failures Robot]

39 failures in 3288 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 5
• mozilla-beta: 17
• mozilla-esr115: 3
• try: 3
• mozilla-central: 7
• mozilla-release: 4

Platform and build breakdown:

• windows10-64-2009-qr: 4
  • opt: 4
• windows11-64-2009-shippable-qr: 16
  • opt: 16
• windows11-32-2009-shippable-qr: 8
  • opt: 8
• windows11-64-2009-devedition-qr: 3
  • opt: 3
• windows10-64-2009-shippable-qr: 6
  • opt: 6
• windows11-64-2009-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1861923&startday=2023-11-06&endday=2023-11-12&tree=all

Comment 7

[Valentin Gosu [:valentin]]

Attachment: Bug 1861923 - Diagnostic patch for test_race_cache_with_network.js r=#necko

Depends on D193362

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/076ac3911ce9
Diagnostic patch for test_race_cache_with_network.js r=necko-reviewers,kershaw

Comment 9

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/076ac3911ce9

Comment 10

[Intermittent Failures Robot]

32 failures in 3495 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #50 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 11
• autoland: 8
• mozilla-beta: 1
• mozilla-release: 3
• try: 9

Platform and build breakdown:

• windows11-64-2009-shippable-qr: 15
  • opt: 15
• android-em-7-0-x86_64-qr: 1
  • debug-isolated-process: 1
• windows11-64-2009-qr: 3
  • opt: 3
• windows11-32-2009-qr: 1
  • opt: 1
• windows10-64-2009-shippable-qr: 5
  • opt: 5
• windows11-64-2009-devedition-qr: 3
  • opt: 3
• windows10-64-2009-qr: 1
  • opt: 1
• windows11-32-2009-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1861923&startday=2023-11-13&endday=2023-11-19&tree=all

Comment 11

[Cosmin Sabou [:CosminS]]

Failure log since latest patch: https://treeherder.mozilla.org/logviewer?job_id=437000918&repo=mozilla-central

Comment 12

[Intermittent Failures Robot]

62 failures in 3623 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 20
• try: 8
• autoland: 7
• mozilla-esr115: 2
• mozilla-beta: 24
• comm-central: 1

Platform and build breakdown:

• windows11-64-2009-shippable-qr: 26
  • opt: 26
• windows10-64-2009-shippable-qr: 15
  • opt: 15
• windows10-64-2009-qr: 4
  • opt: 4
• windows11-32-2009-shippable-qr: 9
  • opt: 9
• windows11-64-2009-devedition-qr: 4
  • opt: 4
• windows11-64-2009-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1861923&startday=2023-11-20&endday=2023-11-26&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 4108 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1861923&startday=2023-11-27&endday=2023-12-03&tree=all

Comment 14

[Valentin Gosu [:valentin]]

Windows-opt test was disabled in bug 1866777. I'll dupe to that and continue the investigation there.