Closed Bug 1762105 Opened 4 years ago Closed 3 years ago

Intermittent TV-fis security/manager/ssl/tests/unit/test_keysize_ev.js | single tracking bug

Categories

(Core :: Security: PSM, defect, P5)

Product:
Core
Component:
Security: PSM
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE
Tracking Flags:
Tracking Status
firefox-esr91 --- unaffected
firefox98 --- unaffected
firefox99 --- unaffected
firefox100 --- wontfix
firefox101 --- wontfix

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [psm-intermittent])

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=372773312&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S9NL2RoFSEmbBZ6mVbpWbQ/runs/1/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S9NL2RoFSEmbBZ6mVbpWbQ/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2022-03-30T02:57:17.929Z] 02:57:17     INFO -  TEST-START | security/manager/ssl/tests/unit/test_keysize_ev.js
[task 2022-03-30T02:57:17.999Z] 02:57:17     INFO -  adb launch_application: am startservice -W -n 'org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.XpcshellTestRunnerService$i0' -a android.intent.action.MAIN --es env0 XPCOM_DEBUG_BREAK=stack-and-abort --es env1 MOZ_CRASHREPORTER=1 --es env2 MOZ_CRASHREPORTER_NO_REPORT=1 --es env3 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env4 MOZ_DEVELOPER_REPO_DIR=/builds/worker/checkouts/gecko --es env5 MOZ_DISABLE_CONTENT_SANDBOX=1 --es env6 MOZ_FETCHES_DIR=/builds/worker/fetches --es env7 MOZ_DISABLE_SOCKET_PROCESS=1 --es env8 LD_LIBRARY_PATH=/data/local/tmp/test_root/xpcb --es env9 MOZ_LINKER_CACHE=/data/local/tmp/test_root/xpcb --es env10 GRE_HOME=/data/local/tmp/test_root/xpcb --es env11 XPCSHELL_TEST_PROFILE_DIR=/data/local/tmp/test_root/xpc/p/3d7fe267-60af-4295-b975-0cac878ca557 --es env12 HOME=/data/local/tmp/test_root/xpc/p --es env13 XPCSHELL_TEST_TEMP_DIR=/data/local/tmp/test_root/xpc/tmp/5b1a033c-79aa-462e-802a-cf02a0b4e2aa --es env14 MOZ_ANDROID_DATA_DIR=/data/local/tmp/test_root/xpcb --es env15 MOZ_IN_AUTOMATION=1 --es env16 MOZ_ANDROID_CPU_ABI=x86_64 --es env17 MOZHTTP2_PORT=38825 --es env18 MOZNODE_EXEC_PORT=37067 --es env19 MOZ_CHAOSMODE=0xfb --es env20 TMPDIR=/data/local/tmp/test_root/xpc/p/3d7fe267-60af-4295-b975-0cac878ca557 --es env21 XPCSHELL_MINIDUMP_DIR=/data/local/tmp/test_root/xpc/minidumps/3d7fe267-60af-4295-b975-0cac878ca557 --es arg0 -g --es arg1 /data/local/tmp/test_root/xpcb --es arg2 --greomni --es arg3 /data/local/tmp/test_root/xpcb/geckoview-test_runner.apk --es arg4 -m --es arg5 -e --es arg6 'const _HEAD_JS_PATH = "/data/local/tmp/test_root/xpc/head.js";' --es arg7 -e --es arg8 'const _MOZINFO_JS_PATH = "/data/local/tmp/test_root/xpc/p/3d7fe267-60af-4295-b975-0cac878ca557/mozinfo.json";' --es arg9 -e --es arg10 'const _PREFS_FILE = "/data/local/tmp/test_root/xpc/user.js";' --es arg11 -e --es arg12 'const _TESTING_MODULES_DIR = "/data/local/tmp/test_root/xpc/m";' --es arg13 -f --es arg14 /data/local/tmp/test_root/xpc/head.js --es arg15 -e --es arg16 'const _HEAD_FILES = ["/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/head_psm.js"];' --es arg17 -e --es arg18 'const _JSDEBUGGER_PORT = 0;' --es arg19 -e --es arg20 'const _TEST_CWD = "/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit";' --es arg21 -e --es arg22 'const _TEST_FILE = ["test_keysize_ev.js"];' --es arg23 -e --es arg24 'const _TEST_NAME = "security/manager/ssl/tests/unit/test_keysize_ev.js";' --es arg25 -e --es arg26 '_execute_test(); quit(0);' --ez use_multiprocess True --es out_file /data/local/tmp/test_root/xpc/logs/xpcshell-ad4df0b7-e673-4308-922f-e58ee7f366ea.log
[task 2022-03-30T02:57:18.237Z] 02:57:18     INFO -  remotexpcshelltests.py | security/manager/ssl/tests/unit/test_keysize_ev.js | 26590 | Launched Test App
[task 2022-03-30T02:57:57.405Z] 02:57:57     INFO -  remotexpcshelltests.py | security/manager/ssl/tests/unit/test_keysize_ev.js | 26590 | Application ran for: 0:00:39.475441
[task 2022-03-30T02:57:57.489Z] 02:57:57  WARNING -  TEST-UNEXPECTED-FAIL | security/manager/ssl/tests/unit/test_keysize_ev.js | xpcshell return code: 0
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  TEST-INFO took 39559ms
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  >>>>>>>
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  running event loop
[task 2022-03-30T02:57:57.489Z] 02:57:57     INFO -  security/manager/ssl/tests/unit/test_keysize_ev.js | Starting
[task 2022-03-30T02:57:57.490Z] 02:57:57     INFO -  (xpcshell/head.js) | test pending (2)
[task 2022-03-30T02:57:57.490Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - test sanity check: the small-key EV root must have the same fingerprint as the corresponding entry in ExtendedValidation.cpp - "40:AB:5D:A5:89:15:A9:4B:82:87:B8:A6:9A:84:B1:DB:7A:9D:DB:B8:4E:E1:23:E3:C6:64:E7:50:DC:35:8C:68" == "40:AB:5D:A5:89:15:A9:4B:82:87:B8:A6:9A:84:B1:DB:7A:9D:DB:B8:4E:E1:23:E3:C6:64:E7:50:DC:35:8C:68"
[task 2022-03-30T02:57:57.490Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Binary util GenerateOCSPResponse should exist - true == true
[task 2022-03-30T02:57:57.491Z] 02:57:57     INFO -  "argArray = sql:test_keysize_ev/,good,ev_ee_rsa_2048-ev_int_rsa_2048-evroot,unused,0,/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/0.ocsp"
[task 2022-03-30T02:57:57.491Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Process exit value should be 0 - 0 == 0
[task 2022-03-30T02:57:57.491Z] 02:57:57     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2022-03-30T02:57:57.491Z] 02:57:57     INFO -  "got request for: /ev_ee_rsa_2048-ev_int_rsa_2048-evroot/"
[task 2022-03-30T02:57:57.491Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Actual and expected base path should match - "ev_ee_rsa_2048-ev_int_rsa_2048-evroot" == "ev_ee_rsa_2048-ev_int_rsa_2048-evroot"
[task 2022-03-30T02:57:57.492Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - expectedCertNames should contain >= 1 entries - true == true
[task 2022-03-30T02:57:57.492Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - verifying ev_ee_rsa_2048-ev_int_rsa_2048-evroot: should get error 0 - 0 == 0
[task 2022-03-30T02:57:57.492Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - verifying ev_ee_rsa_2048-ev_int_rsa_2048-evroot: should be EV - true == true
[task 2022-03-30T02:57:57.492Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Should have 0 remaining expected OCSP responses - 0 == 0
[task 2022-03-30T02:57:57.493Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Should have 0 remaining expected base paths - 0 == 0
[task 2022-03-30T02:57:57.493Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Binary util GenerateOCSPResponse should exist - true == true
[task 2022-03-30T02:57:57.493Z] 02:57:57     INFO -  "argArray = sql:test_keysize_ev/,good,ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040,unused,0,/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/0.ocsp"
[task 2022-03-30T02:57:57.493Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Process exit value should be 0 - 0 == 0
[task 2022-03-30T02:57:57.494Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - verifying ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040: should get error 0 - 0 == 0
[task 2022-03-30T02:57:57.494Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - verifying ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040: should not be EV - false == false
[task 2022-03-30T02:57:57.494Z] 02:57:57  WARNING -  TEST-UNEXPECTED-FAIL | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Should have 0 remaining expected OCSP responses - 1 == 0
[task 2022-03-30T02:57:57.494Z] 02:57:57     INFO -  test_keysize_ev.js:keySizeTestForEV:69
[task 2022-03-30T02:57:57.494Z] 02:57:57     INFO -  /data/local/tmp/test_root/xpc/head.js:_do_main:240
[task 2022-03-30T02:57:57.494Z] 02:57:57     INFO -  /data/local/tmp/test_root/xpc/head.js:_execute_test:603
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  -e:null:1
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  exiting test
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  Unexpected exception NS_ERROR_ABORT:
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  _abort_failed_test@/data/local/tmp/test_root/xpc/head.js:874:20
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  do_report_result@/data/local/tmp/test_root/xpc/head.js:975:5
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  Assert<@/data/local/tmp/test_root/xpc/head.js:75:21
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  proto.report@resource://testing-common/Assert.jsm:228:10
[task 2022-03-30T02:57:57.495Z] 02:57:57     INFO -  equal@resource://testing-common/Assert.jsm:270:8
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  stop@/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/head_psm.js:868:14
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  stopOCSPResponder/<@/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/head_psm.js:903:15
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  stopOCSPResponder@/data/local/tmp/test_root/xpc/security/manager/ssl/tests/unit/head_psm.js:902:10
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  keySizeTestForEV@test_keysize_ev.js:69:9
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  _do_main@/data/local/tmp/test_root/xpc/head.js:240:6
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  _execute_test@/data/local/tmp/test_root/xpc/head.js:603:5
[task 2022-03-30T02:57:57.496Z] 02:57:57     INFO -  @-e:1:1
[task 2022-03-30T02:57:57.497Z] 02:57:57     INFO -  exiting test
[task 2022-03-30T02:57:57.497Z] 02:57:57     INFO -  "got request for: /ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040/"
[task 2022-03-30T02:57:57.497Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - Actual and expected base path should match - "ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040" == "ev_ee_rsa_2048-ev_int_rsa_2048-ev_root_rsa_2040"
[task 2022-03-30T02:57:57.497Z] 02:57:57     INFO -  TEST-PASS | security/manager/ssl/tests/unit/test_keysize_ev.js |  - expectedCertNames should contain >= 1 entries - true == true
[task 2022-03-30T02:57:57.497Z] 02:57:57     INFO -  <<<<<<<
[task 2022-03-30T02:57:57.589Z] 02:57:57     INFO -  Cleaning up profile for /builds/worker/workspace/build/tests/xpcshell/tests/security/manager/ssl/tests/unit/test_keysize_ev.js folder: /data/local/tmp/test_root/xpc/p/3d7fe267-60af-4295-b975-0cac878ca557
[task 2022-03-30T02:57:58.378Z] 02:57:58     INFO -  TEST-START | security/manager/ssl/tests/unit/test_keysize_ev.js

:keeler, since you are the author of the regressor, bug 1735386, could you take a look?
For more information, please visit auto_nag documentation.

Flags: needinfo?(dkeeler)

Set release status flags based on info from the regressing bug 1735386

status-firefox100: --- → affected
status-firefox98: --- → unaffected
status-firefox99: --- → unaffected
status-firefox-esr91: --- → unaffected
Has Regression Range: --- → yes

I suspect the recent changes exposed a preexisting issue, but I'll have a look.

Assignee: nobody → dkeeler
Flags: needinfo?(dkeeler)
Whiteboard: [psm-intermittent][psm-assigned]

Set release status flags based on info from the regressing bug 1735386

status-firefox101: --- → affected

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=378628832&repo=autoland

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 4 years ago → 3 years ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=381448110&repo=autoland

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 3 years ago → 3 years ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=388595377&repo=autoland

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 3 years ago → 3 years ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=395800894&repo=autoland

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Assignee: dkeeler → nobody
Whiteboard: [psm-intermittent][psm-assigned] → [psm-intermittent]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 3 years ago → 3 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.