Closed Bug 1414560 Opened 7 years ago Closed 4 years ago

Intermittent hdiutil: attach failed - image data corrupted

Categories

(Testing :: General, defect, P5)

Version 3
defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: archaeopteryx [at] coole-files.de https://treeherder.mozilla.org/logviewer.html#?job_id=142132307&repo=autoland https://queue.taskcluster.net/v1/task/e6jfNHAoR-i5kYg7PP8wlg/runs/0/artifacts/public/logs/live_backing.log 03:33:36 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '-h'] 03:33:36 INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall -h 03:33:36 INFO - Reading from file tmpfile_stdout 03:33:36 INFO - Output received: 03:33:36 INFO - Usage: mozinstall [options] installer 03:33:36 INFO - Options: 03:33:36 INFO - -h, --help show this help message and exit 03:33:36 INFO - -d DEST, --destination=DEST 03:33:36 INFO - Directory to install application into. [default: 03:33:36 INFO - "/Users/cltbld/tasks/task_1509782337"] 03:33:36 INFO - --app=APP Application being installed. [default: firefox] 03:33:36 INFO - mkdir: /Users/cltbld/tasks/task_1509782337/build/application 03:33:36 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1509782337/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1509782337/build/application'] 03:33:36 INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1509782337/installer.dmg --destination /Users/cltbld/tasks/task_1509782337/build/application 03:33:42 ERROR - Errors received: 03:33:42 INFO - Reading from file tmpfile_stderr 03:33:42 ERROR - hdiutil: attach failed - image data corrupted 03:33:42 ERROR - Traceback (most recent call last): 03:33:42 ERROR - File "/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall", line 9, in <module> 03:33:42 ERROR - load_entry_point('mozInstall==1.14', 'console_scripts', 'mozinstall')() 03:33:42 ERROR - File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 368, in install_cli 03:33:42 ERROR - install_path = install(src, options.dest) 03:33:42 ERROR - File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 153, in install 03:33:42 ERROR - reraise(InstallError, error, trbk) 03:33:42 ERROR - File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 130, in install 03:33:42 ERROR - install_dir = _install_dmg(src, dest) 03:33:42 ERROR - File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 297, in _install_dmg 03:33:42 ERROR - for appFile in os.listdir(appDir): 03:33:42 ERROR - mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1509782337/installer.dmg ([Errno 2] No such file or directory: '')" 03:33:42 ERROR - Return code: 1 03:33:42 WARNING - setting return code to 3
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=198354882&repo=autoland&lineNumber=791 Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/pip', 'freeze'] 23:10:00 INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/pip freeze 23:10:00 INFO - Reading from file tmpfile_stdout 23:10:00 INFO - Detecting whether we're running mozinstall >=1.0... 23:10:00 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '-h'] 23:10:00 INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall -h 23:10:01 INFO - Reading from file tmpfile_stdout 23:10:01 INFO - Output received: 23:10:01 INFO - Usage: mozinstall [options] installer 23:10:01 INFO - Options: 23:10:01 INFO - -h, --help show this help message and exit 23:10:01 INFO - -d DEST, --destination=DEST 23:10:01 INFO - Directory to install application into. [default: 23:10:01 INFO - "/Users/cltbld/tasks/task_1536534531"] 23:10:01 INFO - --app=APP Application being installed. [default: firefox] 23:10:01 INFO - mkdir: /Users/cltbld/tasks/task_1536534531/build/application 23:10:01 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application'] 23:10:01 INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1536534531/installer.dmg --destination /Users/cltbld/tasks/task_1536534531/build/application 23:10:05 ERROR - Errors received: 23:10:05 INFO - Reading from file tmpfile_stderr 23:10:05 ERROR - hdiutil: attach failed - image data corrupted 23:10:05 ERROR - Traceback (most recent call last): 23:10:05 ERROR - File "/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall", line 9, in <module> 23:10:05 ERROR - load_entry_point('mozInstall==1.16.0', 'console_scripts', 'mozinstall')() 23:10:05 ERROR - File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 367, in install_cli 23:10:05 ERROR - install_path = install(src, options.dest) 23:10:05 ERROR - File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 152, in install 23:10:05 ERROR - reraise(InstallError, error, trbk) 23:10:05 ERROR - File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 129, in install 23:10:05 ERROR - install_dir = _install_dmg(src, dest) 23:10:05 ERROR - File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 296, in _install_dmg 23:10:05 ERROR - for appFile in os.listdir(appDir): 23:10:05 ERROR - mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1536534531/installer.dmg ([Errno 2] No such file or directory: '')" 23:10:05 ERROR - Return code: 1 23:10:05 WARNING - setting return code to 3 23:10:05 FATAL - Halting on failure while running ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application'] 23:10:05 FATAL - Running post_fatal callback... 23:10:05 FATAL - Exiting 3
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 7 years ago6 years ago
Resolution: --- → INCOMPLETE

(In reply to Andreea Pavel [:apavel] from comment #12)

Can you please take a look?

This is unrelated to bug 1547721.

It looks like sometimes the DMG image gets corrupted somewhere. A few weeks ago this happened on one of tcampbell's autoland commits. It seems to affect random revisions.

Flags: needinfo?(jdemooij)
No longer regressed by: 1547721

Jobs that pass and jobs that fail are downloading the same DMG. This seems like an infrastructure problem. Maybe someone with TaskCluster knowledge can figure out which machines the jobs failed on. This seems quite rare though and is probably not worth the time for anyone to dig deeper and see if it goes away.

Next time it happens, it is probably worth re-triggering the build itself and see if that helps.

Status: REOPENED → RESOLVED
Closed: 6 years ago6 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 6 years ago6 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=263554335&repo=autoland&lineNumber=814

[task 2019-08-26T19:53:18.126Z] 19:53:18 INFO - Starting resource monitoring.
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - [mozharness: 2019-08-26 19:53:18.130421Z] Finished create-virtualenv step (success)
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - [mozharness: 2019-08-26 19:53:18.131143Z] Running install step.
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Running pre-action listener: _resource_record_pre_action
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Running main action method: install
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/pip', 'freeze']
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/pip freeze
[task 2019-08-26T19:53:18.430Z] 19:53:18 INFO - Reading from file tmpfile_stdout
[task 2019-08-26T19:53:18.430Z] 19:53:18 INFO - Reading from file tmpfile_stderr
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Detecting whether we're running mozinstall >=1.0...
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall', '-h']
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall -h
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Reading from file tmpfile_stdout
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Output received:
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Usage: mozinstall [options] installer
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Options:
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - -h, --help show this help message and exit
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - -d DEST, --destination=DEST
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - Directory to install application into. [default:
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - "/Users/cltbld/tasks/task_1566849098"]
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - --app=APP Application being installed. [default: firefox]
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - mkdir: /Users/cltbld/tasks/task_1566849098/build/application
[task 2019-08-26T19:53:18.681Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1566849098/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1566849098/build/application']
[task 2019-08-26T19:53:18.681Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1566849098/installer.dmg --destination /Users/cltbld/tasks/task_1566849098/build/application
[task 2019-08-26T19:53:24.856Z] 19:53:24 ERROR - Errors received:
[task 2019-08-26T19:53:24.856Z] 19:53:24 INFO - Reading from file tmpfile_stderr
[task 2019-08-26T19:53:24.856Z] 19:53:24 ERROR - hdiutil: attach failed - image data corrupted
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - Traceback (most recent call last):
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall", line 9, in <module>
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - load_entry_point('mozInstall==2.0.0', 'console_scripts', 'mozinstall')()
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 360, in install_cli
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - install_path = install(src, options.dest)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 152, in install
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - reraise(InstallError, error, trbk)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 129, in install
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - install_dir = _install_dmg(src, dest)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 293, in _install_dmg
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - for appFile in os.listdir(appDir):
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1566849098/installer.dmg ([Errno 2] No such file or directory: '')"
[task 2019-08-26T19:53:24.858Z] 19:53:24 ERROR - Return code: 1

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 6 years ago6 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 6 years ago5 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 5 years ago5 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 5 years ago4 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.