Closed Bug 1869953 Opened 2 years ago Closed 9 days ago

Intermittent iscript.exceptions.IScriptError: ('%s in %s exited %s!\n%s', ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '/builds/scriptworker/work

Categories

(Release Engineering :: Release Automation, defect, P5)

Product:
Release Engineering
Component:
Release Automation
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=440031395&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dvVTAOxdSfy5LGosupYWng/runs/0/artifacts/public/logs/live_backing.log

2023-12-13 21:51:41,883 - iscript.autograph - DEBUG - Widevine files to sign: {}
2023-12-13 21:51:41,883 - iscript.mac - INFO - Unlocking signing keychain /builds/scriptworker/certs/mozilla.20220330.keychain
2023-12-13 21:51:42,317 - iscript.hardened_sign - WARNING - Profile already exist. Replacing /builds/scriptworker/work/4/Firefox Nightly.app/Contents/embedded.provisionprofile
2023-12-13 21:51:42,318 - iscript.hardened_sign - DEBUG - Copied /builds/scriptworker/provisionprofiles/orgmozillanightly.provisionprofile to /builds/scriptworker/work/4/Firefox Nightly.app/Contents/embedded.provisionprofile
2023-12-13 21:51:42,318 - scriptworker_client.utils - INFO - Running ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '--entitlements', PosixPath('/builds/scriptworker/work/tmp_resources/plugin-container.xml'), '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/plugin-container.app'] in /builds/scriptworker/work/0 ...
2023-12-13 21:51:42,375 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/plugin-container.app: replacing existing signature
2023-12-13 21:51:42,496 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/plugin-container.app: signed app bundle with Mach-O universal (x86_64 arm64) [org.mozilla.plugincontainer]
2023-12-13 21:51:42,498 - scriptworker_client.utils - INFO - ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '--entitlements', PosixPath('/builds/scriptworker/work/tmp_resources/plugin-container.xml'), '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/plugin-container.app'] in /builds/scriptworker/work/0 exited 0
2023-12-13 21:51:42,499 - scriptworker_client.utils - INFO - Running ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '--entitlements', PosixPath('/builds/scriptworker/work/tmp_resources/media-plugin-helper.xml'), '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/media-plugin-helper.app'] in /builds/scriptworker/work/0 ...
2023-12-13 21:51:42,558 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/media-plugin-helper.app: replacing existing signature
2023-12-13 21:51:42,661 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/media-plugin-helper.app: signed app bundle with Mach-O universal (x86_64 arm64) [org.mozilla.firefox-nightly-media-plugin-helper]
2023-12-13 21:51:42,663 - scriptworker_client.utils - INFO - ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '--entitlements', PosixPath('/builds/scriptworker/work/tmp_resources/media-plugin-helper.xml'), '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/media-plugin-helper.app'] in /builds/scriptworker/work/0 exited 0
2023-12-13 21:51:42,664 - scriptworker_client.utils - INFO - Running ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/crashreporter.app', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/updater.app', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/Library/LaunchServices/org.mozilla.updater', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/XUL', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/pingsender', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/minidump-analyzer', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libfreebl3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/liblgpllibs.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libsoftokn3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libosclientcerts.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozavutil.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozglue.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libgkcodecs.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libipcclientcerts.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozavcodec.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libnssckbi.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libnss3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/Resources/gmp-clearkey/0.1/libclearkey.dylib'] in /builds/scriptworker/work/0 ...
2023-12-13 21:51:42,725 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/crashreporter.app: replacing existing signature
2023-12-13 21:51:42,840 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/crashreporter.app: signed app bundle with Mach-O universal (x86_64 arm64) [org.mozilla.crashreporter]
2023-12-13 21:51:42,847 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/updater.app: replacing existing signature
2023-12-13 21:51:43,002 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/updater.app: signed app bundle with Mach-O universal (x86_64 arm64) [org.mozilla.updater]
2023-12-13 21:51:43,009 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/Library/LaunchServices/org.mozilla.updater: replacing existing signature
2023-12-13 21:51:43,115 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/Library/LaunchServices/org.mozilla.updater: signed Mach-O universal (x86_64 arm64) [org.mozilla.updater]
2023-12-13 21:51:43,146 - scriptworker_client.utils - INFO - /builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/XUL: replacing existing signature
2023-12-13 21:51:45,352 - scriptworker_client.client - ERROR - Failed to run async_main; exiting 1
Traceback (most recent call last):
  File "/builds/scriptworker/virtualenv/lib/python3.8/site-packages/scriptworker_client-1.0.0-py3.8.egg/scriptworker_client/client.py", line 178, in _handle_asyncio_loop
    await async_main(config, task)
  File "/builds/scriptworker/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/script.py", line 100, in async_main
    await func(config, task, **args)
  File "/builds/scriptworker/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/hardened_sign.py", line 209, in sign_hardened_behavior
    await run_command(
  File "/builds/scriptworker/virtualenv/lib/python3.8/site-packages/scriptworker_client-1.0.0-py3.8.egg/scriptworker_client/utils.py", line 246, in run_command
    raise exception(
iscript.exceptions.IScriptError: ('%s in %s exited %s!\n%s', ['codesign', '--verbose', '--sign', '43AQ936H96', '--keychain', '/builds/scriptworker/certs/mozilla.20220330.keychain', '--force', '--options', 'runtime', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/crashreporter.app', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/updater.app', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/Library/LaunchServices/org.mozilla.updater', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/XUL', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/pingsender', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/minidump-analyzer', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libfreebl3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/liblgpllibs.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libsoftokn3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libosclientcerts.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozavutil.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozglue.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libgkcodecs.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libipcclientcerts.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libmozavcodec.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libnssckbi.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/MacOS/libnss3.dylib', '/builds/scriptworker/work/0/Firefox Nightly.app/Contents/Resources/gmp-clearkey/0.1/libclearkey.dylib'], '/builds/scriptworker/work/0', -11, '')
exit code: 1

Not sure what the right component is for scriptworker issues, but releng is probably closer than build.

Product: Firefox Build System → Release Engineering
QA Contact: jlorenzo
Component: General → Release Automation: Signing
QA Contact: jlorenzo

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=465445112&repo=mozilla-central

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 1 year ago → 11 months ago
Resolution: --- → INCOMPLETE
Component: Release Automation: Signing → Release Automation

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=488937540&repo=mozilla-beta

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 11 months ago → 4 months ago
Resolution: --- → INCOMPLETE

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=507685186&repo=mozilla-central

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 4 months ago → 9 days ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.