Open Bug 1585916 Opened 5 years ago Updated 2 years ago

Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test"/"ev-test-intermediate"

Categories

(Core :: Security: PSM, defect, P5)

Product:
Core
Component:
Security: PSM
Type:
defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Assigned: alexical)

References

Details

(Keywords: intermittent-failure, leave-open, regression, Whiteboard: [retriggered][stockwell disabled])

Attachments

(2 files)

Bug 1585916 - disable test_session_resumption.js on win10 ccov qr r=keeler
47 bytes, text/x-phabricator-request
Details | Review
Bug 1585916 - disable test_session_resumption.js on win for frequent failures. r=#intermittent-reviewers
48 bytes, text/x-phabricator-request
Details | Review

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=269570272&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/aZdLyLodRbazIs3lBtpOMg/runs/0/artifacts/public/logs/live_backing.log

[task 2019-10-03T09:09:47.151Z] 09:09:47 INFO - TEST-PASS | security/manager/ssl/tests/unit/test_pinning_header_parsing.js | took 1566ms
[task 2019-10-03T09:09:47.216Z] 09:09:47 INFO - TEST-START | security/manager/ssl/tests/unit/test_session_resumption.js
[task 2019-10-03T09:09:52.602Z] 09:09:52 WARNING - TEST-UNEXPECTED-FAIL | security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0
[task 2019-10-03T09:09:52.603Z] 09:09:52 INFO - TEST-INFO took 5383ms
[task 2019-10-03T09:09:52.603Z] 09:09:52 INFO - >>>>>>>
[task 2019-10-03T09:09:52.603Z] 09:09:52 INFO - (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2019-10-03T09:09:52.604Z] 09:09:52 INFO - (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2019-10-03T09:09:52.604Z] 09:09:52 INFO - (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2019-10-03T09:09:52.605Z] 09:09:52 INFO - running event loop
[task 2019-10-03T09:09:52.606Z] 09:09:52 INFO - security/manager/ssl/tests/unit/test_session_resumption.js | Starting
[task 2019-10-03T09:09:52.607Z] 09:09:52 INFO - (xpcshell/head.js) | test pending (2)
[task 2019-10-03T09:09:52.607Z] 09:09:52 INFO - TEST-PASS | security/manager/ssl/tests/unit/test_session_resumption.js | - Binary util BadCertAndPinningServer should exist - true == true
[task 2019-10-03T09:09:52.607Z] 09:09:52 INFO - TEST-PASS | security/manager/ssl/tests/unit/test_session_resumption.js | - certificate folder (bad_certs) should exist - true == true
[task 2019-10-03T09:09:52.608Z] 09:09:52 INFO - (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2019-10-03T09:09:52.608Z] 09:09:52 INFO - PID 14864 | sending 'GET / HTTP/1.0
[task 2019-10-03T09:09:52.608Z] 09:09:52 INFO - PID 14864 | '
[task 2019-10-03T09:09:52.609Z] 09:09:52 INFO - (xpcshell/head.js) | test pending (2)
[task 2019-10-03T09:09:52.610Z] 09:09:52 INFO - (xpcshell/head.js) | test finished (2)
[task 2019-10-03T09:09:52.610Z] 09:09:52 INFO - PID 14864 | HTTP/1.0 200 OK
[task 2019-10-03T09:09:52.611Z] 09:09:52 INFO - PID 14864 | content-type: text/plain
[task 2019-10-03T09:09:52.611Z] 09:09:52 INFO - PID 14864 | connection: close
[task 2019-10-03T09:09:52.612Z] 09:09:52 INFO - PID 14864 | server: httpd.js
[task 2019-10-03T09:09:52.613Z] 09:09:52 INFO - PID 14864 | date: Thu, 03 O
[task 2019-10-03T09:09:52.613Z] 09:09:52 INFO - (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2019-10-03T09:09:52.613Z] 09:09:52 INFO - PID 14864 | ct 2019 09:09:4
[task 2019-10-03T09:09:52.614Z] 09:09:52 INFO - (xpcshell/head.js) | test finished (2)
[task 2019-10-03T09:09:52.614Z] 09:09:52 INFO - PID 14864 | 7 GMT
[task 2019-10-03T09:09:52.615Z] 09:09:52 INFO - PID 14864 | content-length: 3
[task 2019-10-03T09:09:52.615Z] 09:09:52 INFO - security/manager/ssl/tests/unit/test_session_resumption.js | Starting
[task 2019-10-03T09:09:52.616Z] 09:09:52 INFO - (xpcshell/head.js) | test pending (2)
[task 2019-10-03T09:09:52.616Z] 09:09:52 INFO - TEST-PASS | security/manager/ssl/tests/unit/test_session_resumption.js | - Binary util GenerateOCSPResponse should exist - true == true
[task 2019-10-03T09:09:52.617Z] 09:09:52 INFO - "argArray = sql:bad_certs,good,ev-test,unused,0,C:\tasks\task_1570091260\build\tests\xpcshell\tests\security\manager\ssl\tests\unit\0.ocsp"

Tier 1 failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=301989976&repo=autoland&lineNumber=11205

Summary: Intermittent tier 2 security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test" → Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test"
See Also: → 1678537
Summary: Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test" → Perma tier2 security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test"

This got more frequent, mostly on Windows with code coverage. Do you want to investigate or shall the test get disabled on that platform?

Flags: needinfo?(dkeeler)
Whiteboard: [stockwell needswork:owner]

Let's disable it on that platform for now. Any idea which changeset caused the increase in failures?

Flags: needinfo?(dkeeler)
Assignee: nobody → apavel
Status: NEW → ASSIGNED
Keywords: leave-open
Whiteboard: [stockwell needswork:owner] → [stockwell needswork:owner][stockwell disabled]
Pushed by rmaries@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/713eeb6933d8
disable test_session_resumption.js on win10 ccov qr r=keeler DONTBUILD

(In reply to Dana Keeler (she/her) (use needinfo) (:keeler for reviews) from comment #51)

Any idea which changeset caused the increase in failures?

Could it be from bug 1634065? That's in the push range when it got frequent. Trying to add the task to the parent push of bug 1634065 was failed.

Summary: Perma tier2 security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test" → Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test"
Assignee: apavel → nobody
Status: ASSIGNED → NEW
Summary: Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test" → Intermittent security/manager/ssl/tests/unit/test_session_resumption.js | xpcshell return code: 0 | Actual and expected base path should match - "" == "ev-test"/"ev-test-intermediate"

Unfortunately bug 1510226 is sweeping enough that in theory anything weird we see could be caused by it. I think that if it is causing anything, though, the most likely reason is not that the patch has a bug, but just that it changes the timing of things, and so existing intermittent problems would just happen to show up at different rates as a result.

That being said, I'm not 100% sure I see the argument here - the uptick in the rate of this doesn't look like it exactly lines up with the patch from bug 1510226?

Flags: needinfo?(dothayer)

@Doug: Thank you for looking. The graph matches the 25th of January, when your patch landed https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2021-01-23&endday=2021-02-03&tree=trunk&bug=1585916

Hi Dana, can you assign someone to take a look? At this reach it will probably reach the disable recommended queue.

Flags: needinfo?(dkeeler)

Oh I see better now - sorry, it seems I wasn't taking a close enough look. Let me poke at this a bit tomorrow and see if anything shakes out at least.

Flags: needinfo?(dothayer)

Assigning myself - it's pretty certainly related to the patch from bug 1510226, so I think the burden of proving that it's not the fault of that patch sits with me, if that is indeed the case.

Assignee: nobody → dothayer
Flags: needinfo?(dothayer)
Flags: needinfo?(dkeeler)

Doug should we disable the test until there is a fix?

Flags: needinfo?(dothayer)

That's fine by me, if it's causing headaches. It's proving to be slow to debug.

Flags: needinfo?(dothayer)
Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered][stockwell disabled]
Pushed by archaeopteryx@coole-files.de:
https://hg.mozilla.org/integration/autoland/rev/ead0834b9af5
disable test_session_resumption.js on win for frequent failures. r=intermittent-reviewers,jmaher DONTBUILD
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: