1414002 - Update build/pgo/certs NSS databases to cert9+key4

Status: RESOLVED DUPLICATE of bug 1439378

(Core :: Security: PSM, enhancement, P3)

Description

[J.C. Jones [:jcj] (he/they)]

The NSS databases in build/pgo/certs -- which are used for tests such as devtools/client/webconsole/test/browser_webconsole_certificate_messages.js -- are using the old NSS format. If you attempt to update them with a recent version of certutil/pk12util (as I needed to for Bug 1409259), they upgrade to cert9+key4.

Upon upgrading, the mochitests fail to connect to the test hosts. 

Example:

######
### Now running mochitest-browser with subsuite devtools.
######

Checking for ssltunnel processes...
Checking for xpcshell processes...
SUITE-START | Running 1 tests
Running manifest: devtools/client/webconsole/test/browser.ini
Increasing default timeout to 90 seconds
pk12util: PKCS12 IMPORT SUCCESSFUL
MochitestServer : launching [u'/Users/jcjones/hg/mozilla-central/obj-x86_64-apple-darwin16.7.0/dist/bin/xpcshell', '-g', u'/Users/jcjones/hg/mozilla-central/obj-x86_64-apple-darwin16.7.0/dist/NightlyDebug.app/Contents/Resources', '-v', '170', '-f', u'/Users/jcjones/hg/mozilla-central/obj-x86_64-apple-darwin16.7.0/dist/bin/components/httpd.js', '-e', "const _PROFILE_PATH = '/var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpE4WWLK.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', '/Users/jcjones/hg/mozilla-central/obj-x86_64-apple-darwin16.7.0/_tests/testing/mochitest/server.js']
runtests.py | Server pid: 74078
runtests.py | Websocket server pid: 74079
runtests.py | SSL tunnel pid: 74080
Failed to init NSS: Cannot get error from NSPR.
Couldn't convert chrome URL: chrome://branding/locale/brand.properties
[74078, Main Thread] WARNING: Could not get the program name for a cubeb stream.: 'NS_SUCCEEDED(rv)', file /Users/jcjones/hg/mozilla-central/dom/media/CubebUtils.cpp, line 372
runtests.py | Running with e10s: True
runtests.py | Running tests: start.

Application command: /Users/jcjones/hg/mozilla-central/obj-x86_64-apple-darwin16.7.0/dist/NightlyDebug.app/Contents/MacOS/firefox -marionette -foreground -profile /var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpE4WWLK.mozrunner
runtests.py | Application pid: 74081
TEST-INFO | started process GECKO(74081)
GECKO(74081) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpE4WWLK.mozrunner/runtests_leaks.log
GECKO(74081) | 1509643596743	Marionette	DEBUG	Received observer notification "profile-after-change"
GECKO(74081) | Unable to read VR Path Registry from /Users/jcjones/Library/Application Support/OpenVR/.openvr/openvrpaths.vrpath
GECKO(74081) | 1509643596893	Marionette	DEBUG	Received observer notification "command-line-startup"
GECKO(74081) | 1509643596893	Marionette	INFO	Enabled via --marionette
GECKO(74081) | ++DOCSHELL 0x118261000 == 1 [pid = 74081] [id = {93eb7206-11c7-d849-b63a-de7de70c76cb}]
GECKO(74081) | ++DOMWINDOW == 1 (0x118261800) [pid = 74081] [serial = 1] [outer = 0x0]
GECKO(74081) | ++DOMWINDOW == 2 (0x118265800) [pid = 74081] [serial = 2] [outer = 0x118261800]
GECKO(74081) | ++DOCSHELL 0x11bd60000 == 2 [pid = 74081] [id = {b557f5e1-c300-7a4a-8d91-5abf903fc243}]
GECKO(74081) | ++DOMWINDOW == 3 (0x11bd60800) [pid = 74081] [serial = 3] [outer = 0x0]
GECKO(74081) | ++DOMWINDOW == 4 (0x11bd5f800) [pid = 74081] [serial = 4] [outer = 0x11bd60800]
GECKO(74081) | ++DOCSHELL 0x127684000 == 3 [pid = 74081] [id = {b3ca2b3c-6a16-ee47-becc-5267e95f7cd4}]
GECKO(74081) | ++DOMWINDOW == 5 (0x127684800) [pid = 74081] [serial = 5] [outer = 0x0]
GECKO(74081) | ++DOCSHELL 0x128fee800 == 4 [pid = 74081] [id = {2a73500b-3c30-7940-ad0a-f414a75271df}]
GECKO(74081) | ++DOMWINDOW == 6 (0x12942f000) [pid = 74081] [serial = 6] [outer = 0x0]
GECKO(74081) | ++DOMWINDOW == 7 (0x1295e7800) [pid = 74081] [serial = 7] [outer = 0x12942f000]
GECKO(74081) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpE4WWLK.mozrunner/runtests_leaks_tab_pid74084.log
GECKO(74081) | ++DOMWINDOW == 8 (0x129979800) [pid = 74081] [serial = 8] [outer = 0x127684800]
GECKO(74081) | Unable to read VR Path Registry from /Users/jcjones/Library/Application Support/OpenVR/.openvr/openvrpaths.vrpath
GECKO(74081) | ++DOCSHELL 0x10c116000 == 1 [pid = 74084] [id = {5e7f0ff9-3f0f-d04d-b6b2-c3905b89c0c9}]
GECKO(74081) | ++DOMWINDOW == 1 (0x10c119000) [pid = 74084] [serial = 1] [outer = 0x0]
GECKO(74081) | ++DOMWINDOW == 2 (0x111945800) [pid = 74084] [serial = 2] [outer = 0x10c119000]
GECKO(74081) | ++DOMWINDOW == 3 (0x112303000) [pid = 74084] [serial = 3] [outer = 0x10c119000]
GECKO(74081) | 2017-11-02 10:26:38.656 plugin-container[74084:85467237] *** CFMessagePort: bootstrap_register(): failed 1100 (0x44c) 'Permission denied', port = 0xb137, name = 'com.apple.tsm.portname'
GECKO(74081) | See /usr/include/servers/bootstrap_defs.h for the error codes.
GECKO(74081) | [Child 74084, Main Thread] WARNING: ENSURE_MAIN_PROCESS: called SetBool on font.internaluseonly.changed in a non-main process: file /Users/jcjones/hg/mozilla-central/modules/libpref/Preferences.cpp, line 4933
GECKO(74081) | [Parent 74081, Main Thread] WARNING: Content used context-fill-opacity when not in a context element: file /Users/jcjones/hg/mozilla-central/layout/svg/nsSVGUtils.cpp, line 1646
GECKO(74081) | [Parent 74081, Main Thread] WARNING: 'aRv.Failed()', file /Users/jcjones/hg/mozilla-central/dom/fetch/Request.cpp, line 166
GECKO(74081) | [Parent 74081, Main Thread] WARNING: 'aRv.Failed()', file /Users/jcjones/hg/mozilla-central/dom/fetch/Request.cpp, line 351
GECKO(74081) | [Parent 74081, Main Thread] WARNING: 'aRv.Failed()', file /Users/jcjones/hg/mozilla-central/dom/fetch/Fetch.cpp, line 393
GECKO(74081) | 1509643598830	Marionette	DEBUG	Received observer notification "sessionstore-windows-restored"
GECKO(74081) | [Parent 74081, IndexedDB #1] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80630001: file /Users/jcjones/hg/mozilla-central/storage/mozStorageConnection.cpp, line 710
GECKO(74081) | [Parent 74081, IndexedDB #1] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80630001: file /Users/jcjones/hg/mozilla-central/storage/mozStorageService.cpp, line 756
GECKO(74081) | [Parent 74081, IndexedDB #1] WARNING: Received NS_ERROR_STORAGE_BUSY when attempting to open database '2918063365piupsah.sqlite', retrying for up to 10 seconds: file /Users/jcjones/hg/mozilla-central/dom/indexedDB/ActorsParent.cpp, line 4441
GECKO(74081) | 1509643599349	Marionette	DEBUG	New connections are accepted
GECKO(74081) | 1509643599349	Marionette	INFO	Listening on port 2828
GECKO(74081) | [Parent 74081, Main Thread] WARNING: attempt to modify an immutable nsStandardURL: file /Users/jcjones/hg/mozilla-central/netwerk/base/nsStandardURL.cpp, line 1827
GECKO(74081) | [Parent 74081, Main Thread] WARNING: Failed to retarget HTML data delivery to the parser thread.: file /Users/jcjones/hg/mozilla-central/parser/html/nsHtml5StreamParser.cpp, line 1007
GECKO(74081) | 1509643599431	Marionette	DEBUG	Accepted connection 0 from 127.0.0.1:56727
GECKO(74081) | 1509643599437	Marionette	DEBUG	Closed connection 0
GECKO(74081) | 1509643599440	Marionette	DEBUG	Accepted connection 1 from 127.0.0.1:56728
GECKO(74081) | 1509643599447	Marionette	TRACE	1 -> [0,1,"newSession",{}]
GECKO(74081) | 1509643599582	Marionette	DEBUG	Register listener.js for window 2147483649
GECKO(74081) | 1509643599625	Marionette	TRACE	1 <- [1,1,null,{"sessionId":"fdab68a3-6353-2449-a2c8-89e5cb728e9c","capabilities":{}}]
GECKO(74081) | 1509643599658	Marionette	TRACE	1 -> [0,2,"addon:install",{"path":"/var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpgc_E9E.zip","temporary":false}]
GECKO(74081) | 1509643599774	Marionette	TRACE	1 <- [1,2,null,{"value":"[e-mail]"}]
GECKO(74081) | 1509643599822	Marionette	TRACE	1 -> [0,3,"addon:install",{"path":"/var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpzFuaQl.zip","temporary":false}]
GECKO(74081) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /var/folders/03/tzj_ybfd3f7bxm4qm6cnqfm00000gn/T/tmpE4WWLK.mozrunner/runtests_leaks_tab_pid74085.log
[74078, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004002: file /Users/jcjones/hg/mozilla-central/toolkit/components/resistfingerprinting/nsRFPService.cpp, line 182
GECKO(74081) | 1509643600008	Marionette	TRACE	1 <- [1,3,null,{"value":"[e-mail]"}]
GECKO(74081) | 1509643600013	Marionette	TRACE	1 -> [0,4,"getContext",{}]
GECKO(74081) | 1509643600013	Marionette	TRACE	1 <- [1,4,null,{"value":"content"}]
GECKO(74081) | 1509643600017	Marionette	TRACE	1 -> [0,5,"setContext",{"value":"chrome"}]
GECKO(74081) | 1509643600018	Marionette	TRACE	1 <- [1,5,null,{}]
GECKO(74081) | 1509643600030	Marionette	TRACE	1 -> [0,6,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":[{"testUrl":"about:blank","flavor":"browser-chrome"}],"filename":"runtests.py","script":"/* This Source Code Form is subject to the terms of the Mozilla Public\n * License, v. 2.0. If a copy of the MPL was not distr ...  which flavor and url to load.\nlet ev = new CustomEvent('mochitest-load', {'detail': [flavor, url]});\nwin.dispatchEvent(ev);\n","sandbox":"default","line":1716}]
GECKO(74081) | 1509643600039	Marionette	TRACE	1 <- [1,6,null,{"value":null}]
GECKO(74081) | ++DOMWINDOW == 4 (0x1132da000) [pid = 74084] [serial = 4] [outer = 0x10c119000]
GECKO(74081) | Unable to read VR Path Registry from /Users/jcjones/Library/Application Support/OpenVR/.openvr/openvrpaths.vrpath
GECKO(74081) | 1509643600083	Marionette	TRACE	1 -> [0,7,"setContext",{"value":"content"}]
GECKO(74081) | 1509643600084	Marionette	TRACE	1 <- [1,7,null,{}]
GECKO(74081) | 1509643600103	Marionette	TRACE	1 -> [0,8,"deleteSession",{}]
GECKO(74081) | [Parent 74081, Main Thread] WARNING: NS_ENSURE_TRUE(weak) failed: file /Users/jcjones/hg/mozilla-central/dom/base/nsFrameMessageManager.cpp, line 339
GECKO(74081) | 1509643600110	Marionette	TRACE	1 <- [1,8,null,{}]
GECKO(74081) | [Parent 74081, Main Thread] WARNING: NS_ENSURE_TRUE(weak) failed: file /Users/jcjones/hg/mozilla-central/dom/base/nsFrameMessageManager.cpp, line 339
GECKO(74081) | 1509643600128	Marionette	DEBUG	Closed connection 1
GECKO(74081) | ++DOCSHELL 0x135ddf000 == 5 [pid = 74081] [id = {bb6bc7fd-3574-9a4b-96f1-d93fc20b12e1}]
GECKO(74081) | ++DOMWINDOW == 9 (0x135de0000) [pid = 74081] [serial = 9] [outer = 0x0]
GECKO(74081) | ++DOMWINDOW == 10 (0x135ddd000) [pid = 74081] [serial = 10] [outer = 0x135de0000]
GECKO(74081) | 2017-11-02 10:26:40.200 plugin-container[74085:85467427] *** CFMessagePort: bootstrap_register(): failed 1100 (0x44c) 'Permission denied', port = 0xaa37, name = 'com.apple.tsm.portname'
GECKO(74081) | See /usr/include/servers/bootstrap_defs.h for the error codes.
GECKO(74081) | [Child 74085, Main Thread] WARNING: ENSURE_MAIN_PROCESS: called SetBool on font.internaluseonly.changed in a non-main process: file /Users/jcjones/hg/mozilla-central/modules/libpref/Preferences.cpp, line 4933
GECKO(74081) | [Parent 74081, Main Thread] WARNING: NS_ENSURE_TRUE(aSecondURI) failed: file /Users/jcjones/hg/mozilla-central/dom/base/ThirdPartyUtil.cpp, line 98
GECKO(74081) | --DOCSHELL 0x128fee800 == 4 [pid = 74081] [id = {2a73500b-3c30-7940-ad0a-f414a75271df}]
GECKO(74081) | --DOMWINDOW == 3 (0x111945800) [pid = 74084] [serial = 2] [outer = 0x0] [url = about:blank]
GECKO(74081) | --DOMWINDOW == 9 (0x12942f000) [pid = 74081] [serial = 6] [outer = 0x0] [url = about:blank]
GECKO(74081) | --DOMWINDOW == 8 (0x1295e7800) [pid = 74081] [serial = 7] [outer = 0x0] [url = about:blank]
GECKO(74081) | --DOMWINDOW == 2 (0x112303000) [pid = 74084] [serial = 3] [outer = 0x0] [url = about:blank]

Comment 1

[Dana Keeler (she/her) [:keeler]]

Looks like bug 1441338 took care of this.

Comment 2

[Dana Keeler (she/her) [:keeler]]

Er, bug 1439378, rather.