Intermittent FileNotFoundError: [Errno 2] No such file or directory: '/builds/dep2/work/0/Firefox NightlyDebug.app/Contents/MacOS/plugin-container.app/Contents/Info.plist'
Categories
(Release Engineering :: Release Automation, defect, P5)
Tracking
(Not tracked)
People
(Reporter: intermittent-bug-filer, Assigned: mozilla)
Details
(Keywords: intermittent-failure)
Attachments
(1 file)
Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=355921901&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S_Pnwh93R2KNygSAk35Vpw/runs/0/artifacts/public/logs/live_backing.log
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - Firefox NightlyDebug.app/Contents/Resources/res/cursors/
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/arrowN.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/arrowN@2x.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/arrowS.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/arrowS@2x.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/cell.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/cell@2x.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/colResize.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/colResize@2x.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/help.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/help@2x.png"
2021-10-25 11:44:18,549 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/move.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/move@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/rowResize.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/rowResize@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNE.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNE@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNESW.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNESW@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNS.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNS@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNW.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNW@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNWSE.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeNWSE@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeSE.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeSE@2x.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeSW.png"
2021-10-25 11:44:18,550 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/sizeSW@2x.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/vtIBeam.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/vtIBeam@2x.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/zoomIn.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/zoomIn@2x.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/zoomOut.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/Resources/res/cursors/zoomOut@2x.png"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - WARNING: Firefox NightlyDebug.app/Contents/MacOS/XUL failed verification -- update discarded (will try again).
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - file has vanished: "/tmp/dep1-0-unpack/Firefox NightlyDebug.app/Contents/MacOS/XUL"
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG -
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - sent 222872023 bytes received 2590 bytes 23460485.58 bytes/sec
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - total size is 311684514 speedup is 1.40
2021-10-25 11:44:18,551 - scriptworker_client.utils - DEBUG - rsync error: some files could not be transferred (code 23) at /BuildRoot/Library/Caches/com.apple.xbs/Sources/rsync/rsync-52.200.1/rsync/main.c(996) [sender=2.6.9]
2021-10-25 11:44:18,573 - scriptworker_client.utils - DEBUG - hdiutil: detach failed - No such file or directory
2021-10-25 11:44:23,592 - scriptworker_client.utils - INFO - ['/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/data/unpack-diskimage', '/builds/dep2/work/cot/XoMeKq4kTvysmd-kxPa9YQ/public/build/target.dmg', '/tmp/dep1-0-unpack', '/builds/dep2/work/0'] in /builds/dep2/work/0 exited 0
2021-10-25 11:44:23,593 - iscript.mac - INFO - Unlocking signing keychain /builds/dep2/certs/dep-signing.keychain
2021-10-25 11:44:24,009 - scriptworker_client.utils - INFO - Running ['security', 'list-keychains', '-s', '/builds/dep2/certs/dep-signing.keychain', '/Users/depbld2/Library/Keychains/login.keychain-db', '/Library/Keychains/System.keychain'] in /builds/dep2/work ...
2021-10-25 11:44:24,036 - scriptworker_client.utils - INFO - ['security', 'list-keychains', '-s', '/builds/dep2/certs/dep-signing.keychain', '/Users/depbld2/Library/Keychains/login.keychain-db', '/Library/Keychains/System.keychain'] in /builds/dep2/work exited 0
2021-10-25 11:44:24,036 - iscript.mac - INFO - Signing all apps
2021-10-25 11:44:24,038 - iscript.autograph - INFO - Signing omnija in /builds/dep2/work/0/Firefox NightlyDebug.app...
2021-10-25 11:44:24,040 - iscript.autograph - INFO - Signing widevine in /builds/dep2/work/0/Firefox NightlyDebug.app...
2021-10-25 11:44:24,042 - iscript.autograph - DEBUG - Widevine files to sign: {}
2021-10-25 11:44:24,042 - iscript.mac - INFO - Unlocking signing keychain /builds/dep2/certs/dep-signing.keychain
2021-10-25 11:44:24,378 - scriptworker_client.utils - INFO - Running ['xattr', '-cr', 'Firefox NightlyDebug.app'] in /builds/dep2/work/0 ...
2021-10-25 11:44:24,500 - scriptworker_client.utils - INFO - ['xattr', '-cr', 'Firefox NightlyDebug.app'] in /builds/dep2/work/0 exited 0
2021-10-25 11:44:24,500 - iscript.mac - DEBUG - sign_app: signing Firefox NightlyDebug.app
2021-10-25 11:44:24,503 - iscript.mac - DEBUG - Skipping /builds/dep2/work/0/Firefox NightlyDebug.app/Contents/Resources because it's not in `sign_dirs`.
2021-10-25 11:44:24,504 - iscript.mac - DEBUG - Skipping file iteration in /builds/dep2/work/0/Firefox NightlyDebug.app/Contents because it's the root directory.
2021-10-25 11:44:24,504 - scriptworker_client.utils - INFO - Running ['xattr', '-cr', 'plugin-container.app'] in /builds/dep2/work/0/Firefox NightlyDebug.app/Contents/MacOS ...
2021-10-25 11:44:24,672 - scriptworker_client.utils - INFO - ['xattr', '-cr', 'plugin-container.app'] in /builds/dep2/work/0/Firefox NightlyDebug.app/Contents/MacOS exited 0
2021-10-25 11:44:24,672 - iscript.mac - DEBUG - sign_app: signing plugin-container.app
Traceback (most recent call last):
File "/builds/dep2/virtualenv/bin/iscript", line 33, in <module>
sys.exit(load_entry_point('iscript==1.0.1', 'console_scripts', 'iscript')())
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/script.py", line 78, in main
return sync_main(async_main, default_config=get_default_config())
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/scriptworker_client-1.0.0-py3.8.egg/scriptworker_client/client.py", line 127, in sync_main
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/scriptworker_client-1.0.0-py3.8.egg/scriptworker_client/client.py", line 182, in _handle_asyncio_loop
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/script.py", line 50, in async_main
await sign_and_pkg_behavior(config, task)
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/mac.py", line 1363, in sign_and_pkg_behavior
await sign_all_apps(config, sign_config, entitlements_path, all_paths, provisioning_profile_path)
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/mac.py", line 614, in sign_all_apps
await raise_future_exceptions(futures)
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/scriptworker_client-1.0.0-py3.8.egg/scriptworker_client/aio.py", line 65, in raise_future_exceptions
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/mac.py", line 287, in sign_app
await sign_app(sign_config, abs_dir, entitlements_path)
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/mac.py", line 267, in sign_app
app_executable = get_bundle_executable(app_path)
File "/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/mac.py", line 142, in get_bundle_executable
return plistlib.readPlist(os.path.join(appdir, "Contents", "Info.plist"))["CFBundleExecutable"]
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 99, in readPlist
with _maybe_open(pathOrFile, 'rb') as fp:
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/contextlib.py", line 113, in __enter__
return next(self.gen)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 82, in _maybe_open
with open(pathOrFile, mode) as fp:
FileNotFoundError: [Errno 2] No such file or directory: '/builds/dep2/work/0/Firefox NightlyDebug.app/Contents/MacOS/plugin-container.app/Contents/Info.plist'
exit code: 1
Assignee | ||
Comment 1•3 years ago
|
||
I think the important things to note here:
First, we're having issues with hdiutil, just trying to mount the dmg:
2021-10-25 11:43:54,629 - scriptworker_client.utils - INFO - Running ['/builds/dep2/virtualenv/lib/python3.8/site-packages/iscript-1.0.1-py3.8.egg/iscript/data/unpack-diskimage', '/builds/dep2/work/cot/XoMeKq4kTvysmd-kxPa9YQ/public/build/target.dmg', '/tmp/dep1-0-unpack', '/builds/dep2/work/0'] in /builds/dep2/work/0 ...
2021-10-25 11:43:54,639 - scriptworker_client.utils - DEBUG - mnt already exists, trying to clean up
2021-10-25 11:43:54,671 - scriptworker_client.utils - DEBUG - hdiutil: detach failed - No such file or directory
2021-10-25 11:43:54,675 - scriptworker_client.utils - DEBUG - rm: /tmp/dep1-0-unpack: Permission denied
Second, this is running on dep-mac-v3-signing3, a dep mac signer host which runs 3 different scriptworker instances. And we're in /builds/dep2
but we're using a /tmp/dep1-
prefix for our mountpoint.
I think we're using the wrong dmg prefix, and we happened to collide with an hdiutil mount from the dep1 instance.
Assignee | ||
Comment 2•3 years ago
|
||
Assignee | ||
Comment 3•3 years ago
|
||
The fix should roll out to the mac signers in the next half hour or so.
Comment hidden (Intermittent Failures Robot) |
Updated•2 months ago
|
Description
•