1874627 - Perma security/manager/ssl/tests/unit/test_cert_expiration_canary.js | xpcshell return code: 0 | - verifying Test End-entity: should get error 0 - -8162 == 0

Status: RESOLVED FIXED

(Core :: Security: PSM, defect)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=443290634&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NUH3bcGNQFqw8WuUVdm6fg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-01-15T00:31:26.969Z] 00:31:26     INFO -  TEST-PASS | uriloader/exthandler/tests/unit/test_punycodeURIs.js | took 98ms
[task 2024-01-15T00:31:26.970Z] 00:31:26     INFO -  Retrying tests that failed when run in parallel.
[task 2024-01-15T00:31:26.971Z] 00:31:26     INFO -  TEST-START | security/manager/ssl/tests/unit/test_cert_expiration_canary.js
[task 2024-01-15T00:31:27.085Z] 00:31:27  WARNING -  TEST-UNEXPECTED-FAIL | security/manager/ssl/tests/unit/test_cert_expiration_canary.js | xpcshell return code: 0
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  TEST-INFO took 115ms
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  >>>>>>>
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  running event loop
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  security/manager/ssl/tests/unit/test_cert_expiration_canary.js | Starting
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  (xpcshell/head.js) | test pending (2)
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2024-01-15T00:31:27.086Z] 00:31:27  WARNING -  TEST-UNEXPECTED-FAIL | security/manager/ssl/tests/unit/test_cert_expiration_canary.js |  - verifying Test End-entity: should get error 0 - -8162 == 0
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  -e:null:1
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  exiting test
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  PID 6372 | JavaScript error: /opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js, line 869: NS_ERROR_ABORT:
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  "CONSOLE_MESSAGE: (error) [JavaScript Error: "NS_ERROR_ABORT: " {file: "/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js" line: 869}]
[task 2024-01-15T00:31:27.086Z] 00:31:27     INFO -  _abort_failed_test@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js:869:20
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  do_report_result@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js:981:5
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  Assert<@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js:70:21
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  Assert.prototype.report@resource://testing-common/Assert.sys.mjs:244:10
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  equal@resource://testing-common/Assert.sys.mjs:286:8
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  verifyCertFinished@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/tests/security/manager/ssl/tests/unit/head_psm.js:274:10
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  _do_main@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js:245:6
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  _execute_test@/opt/worker/tasks/task_170527664035023/build/tests/xpcshell/head.js:596:5
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  @-e:1:1
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  "
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  <<<<<<<
[task 2024-01-15T00:31:27.087Z] 00:31:27     INFO -  TEST-START | devtools/client/shared/remote-debugging/adb/xpcshell/test_adb.js

Comment 1

[Intermittent Failures Robot]

11 failures in 3217 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11

Platform and build breakdown:

• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-64-2009-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 6
  • opt: 6
• macosx1100-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1874627&startday=2024-01-08&endday=2024-01-14&tree=all

Comment 2

[Cristina Horotan [:chorotan]]

Hi Dana,
Can you please take a look? Thanks

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1874627 - disable test_cert_expiration_canary.js until in-tree certificates have been renewed

In-tree certificates will expire soon and need renewal.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c99a236b215f
disable test_cert_expiration_canary.js until in-tree certificates have been renewed

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/ae2d8becbc0b
disable test_cert_expiration_canary.js until in-tree certificates have been renewed a=fix

Comment 6

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/ae2d8becbc0b

Comment 7

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/c99a236b215f

Comment 8

[Intermittent Failures Robot]

245 failures in 541 pushes (0.453 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 188
• mozilla-central: 47
• comm-central: 10

Platform and build breakdown:

• linux1804-64-qr: 45
  • debug: 22
  • opt: 23
• macosx1015-64-qr: 20
  • debug: 11
  • opt: 9
• windows11-32-2009-qr: 18
  • debug: 10
  • opt: 8
• android-em-7-0-x86_64-qr: 13
  • debug: 7
  • opt: 6
• windows10-64-2009-qr: 9
  • debug: 5
  • opt: 4
• windows11-64-2009-qr: 27
  • debug: 14
  • opt: 13
• android-em-7-0-x86_64-lite-qr: 6
  • opt: 6
• linux1804-64-tsan-qr: 20
  • opt: 20
• linux1804-64-asan-qr: 23
  • opt: 23
• linux1804-64-shippable-qr: 22
  • opt: 22
• windows11-32-2009-shippable-qr: 7
  • opt: 7
• windows11-64-2009-shippable-qr: 12
  • opt: 12
• macosx1015-64-shippable-qr: 7
  • opt: 7
• macosx1100-64-shippable-qr: 6
  • opt: 6
• linux1804-64-ccov-qr: 5
  • opt: 5
• windows11-64-2009-ccov-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1
• windows10-64-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1874627&startday=2024-01-15&endday=2024-01-15&tree=all

Comment 9

[Dana Keeler (she/her) (use needinfo) [:keeler]]

Attachment: Bug 1874627 - regenerate expiring test certificates for 2024 r?jschanck

Comment 10

[Dana Keeler (she/her) (use needinfo) [:keeler]]

The patch is basically ready to go, but it's going to conflict with bug 1857894, which is on autoland, so I'm waiting for that.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5c10e05cb733
regenerate expiring test certificates for 2024 r=jschanck,necko-reviewers,extension-reviewers,robwu,jesup

Comment 12

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/5c10e05cb733

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:keeler, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox122 to wontfix.

For more information, please visit BugBot documentation.

Comment 14

[Dana Keeler (she/her) (use needinfo) [:keeler]]

Attachment: Bug 1874627 - regenerate expiring test certificates for 2024 (branch patch) r?jschanck

• the certificates were regenerated using ./mach generate-test-certs
• the build/pgo/certs/ changes were made using
  ./mach python build/pgo/genpgocert.py
• the zip files in security/manager/ssl/tests/unit/test_signed_apps/ were
  updated per the directions in the corresponding moz.build file
• security/manager/ssl/tests/unit/test_cert_override_read.js needed manual
  updating

These certificates and other test artifacts will now expire in 2025.

Comment 15

[Dana Keeler (she/her) (use needinfo) [:keeler]]

Comment on attachment 9375550 [details]
Bug 1874627 - regenerate expiring test certificates for 2024 (branch patch) r?jschanck

Beta/Release Uplift Approval Request

• User impact if declined: (test only change)
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): test only change
• String changes made/needed: none
• Is Android affected?: Yes

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: (test only change)
• User impact if declined: (test only change)
• Fix Landed on Version: 123
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): test only change

Comment 16

[Intermittent Failures Robot]

16 failures in 629 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• pine: 16

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 1
  • debug: 1
• windows11-32-2009-qr: 1
  • debug: 1
• windows10-64-2009-qr: 1
  • debug: 1
• windows11-64-2009-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1
• macosx1100-64-shippable-qr: 1
  • opt: 1
• windows11-64-2009-shippable-qr: 1
  • opt: 1
• windows10-64-2009-shippable-qr: 1
  • opt: 1
• windows11-32-2009-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1874627&startday=2024-01-19&endday=2024-01-19&tree=all

Comment 17

[Donal Meehan [:dmeehan]]

Comment on attachment 9375550 [details]
Bug 1874627 - regenerate expiring test certificates for 2024 (branch patch) r?jschanck

This will ride the train to beta with Fx123

Comment 18

[Intermittent Failures Robot]

262 failures in 3599 pushes (0.073 failures/push) were associated with this bug in the last 7 days.

This is the #2 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 188
• mozilla-central: 47
• comm-central: 10
• try: 1
• pine: 16

Platform and build breakdown:

• linux1804-64-qr: 47
  • debug: 24
  • opt: 23
• macosx1015-64-qr: 21
  • debug: 12
  • opt: 9
• windows11-32-2009-qr: 19
  • debug: 11
  • opt: 8
• android-em-7-0-x86_64-qr: 14
  • debug: 8
  • opt: 6
• windows10-64-2009-qr: 10
  • debug: 6
  • opt: 4
• windows11-64-2009-qr: 28
  • debug: 15
  • opt: 13
• android-em-7-0-x86_64-lite-qr: 6
  • opt: 6
• linux1804-64-tsan-qr: 21
  • opt: 21
• linux1804-64-asan-qr: 24
  • opt: 24
• linux1804-64-shippable-qr: 23
  • opt: 23
• windows11-32-2009-shippable-qr: 8
  • opt: 8
• windows11-64-2009-shippable-qr: 13
  • opt: 13
• macosx1015-64-shippable-qr: 8
  • opt: 8
• macosx1100-64-shippable-qr: 7
  • opt: 7
• linux1804-64-ccov-qr: 5
  • opt: 5
• windows11-64-2009-ccov-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• windows10-64-2009-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1874627&startday=2024-01-15&endday=2024-01-21&tree=all

Comment 19

[Donal Meehan [:dmeehan]]

Comment on attachment 9375550 [details]
Bug 1874627 - regenerate expiring test certificates for 2024 (branch patch) r?jschanck

Test-only change approved for 122.0.1

Comment 20

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-release/rev/4e8ebd6294f1

Comment 21

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-esr115/rev/5d7019d9f608

Comment 22

[Pascal Chevrel:pascalc]

https://hg.mozilla.org/releases/mozilla-esr115/rev/5d7019d9f608

Comment 23

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-esr115/rev/025824aab59e

Comment 24

[Daniel Holbert [:dholbert]]

Heads-up, the ESR115 patch here (landed in comment 23) seems to have included an unrelated change, reverting a test-fix for layout/generic/test/file_bug514732_window.xhtml which was recently uplifted in bug 1878346 -- see bug 1878346 comment 14, and this part of the patch that landed in comment 23 here:
https://hg.mozilla.org/releases/mozilla-esr115/rev/025824aab59e#l4.1

It probably makes sense to address this by re-landing over in bug 1878346, but I just wanted to post a heads-up over here as well. Fortunately the consequences weren't dire; it just meant that an intermittent test failure stuck around when it should have been fixed. :)