Closed Bug 1414560 Opened 3 years ago Closed 1 day ago

Intermittent hdiutil: attach failed - image data corrupted

Categories

(Testing :: General, defect, P5)

Version 3
defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=142132307&repo=autoland

https://queue.taskcluster.net/v1/task/e6jfNHAoR-i5kYg7PP8wlg/runs/0/artifacts/public/logs/live_backing.log

03:33:36     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '-h']
03:33:36     INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall -h
03:33:36     INFO - Reading from file tmpfile_stdout
03:33:36     INFO - Output received:
03:33:36     INFO -  Usage: mozinstall [options] installer
03:33:36     INFO -  Options:
03:33:36     INFO -    -h, --help            show this help message and exit
03:33:36     INFO -    -d DEST, --destination=DEST
03:33:36     INFO -                          Directory to install application into. [default:
03:33:36     INFO -                          "/Users/cltbld/tasks/task_1509782337"]
03:33:36     INFO -    --app=APP             Application being installed. [default: firefox]
03:33:36     INFO - mkdir: /Users/cltbld/tasks/task_1509782337/build/application
03:33:36     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1509782337/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1509782337/build/application']
03:33:36     INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1509782337/installer.dmg --destination /Users/cltbld/tasks/task_1509782337/build/application
03:33:42    ERROR - Errors received:
03:33:42     INFO - Reading from file tmpfile_stderr
03:33:42    ERROR -  hdiutil: attach failed - image data corrupted
03:33:42    ERROR -  Traceback (most recent call last):
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall", line 9, in <module>
03:33:42    ERROR -      load_entry_point('mozInstall==1.14', 'console_scripts', 'mozinstall')()
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 368, in install_cli
03:33:42    ERROR -      install_path = install(src, options.dest)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 153, in install
03:33:42    ERROR -      reraise(InstallError, error, trbk)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 130, in install
03:33:42    ERROR -      install_dir = _install_dmg(src, dest)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 297, in _install_dmg
03:33:42    ERROR -      for appFile in os.listdir(appDir):
03:33:42    ERROR -  mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1509782337/installer.dmg ([Errno 2] No such file or directory: '')"
03:33:42    ERROR - Return code: 1
03:33:42  WARNING - setting return code to 3
https://wiki.mozilla.org/Bugmasters#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 3 years ago2 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=198354882&repo=autoland&lineNumber=791

Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/pip', 'freeze']
23:10:00     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/pip freeze
23:10:00     INFO - Reading from file tmpfile_stdout
23:10:00     INFO - Detecting whether we're running mozinstall >=1.0...
23:10:00     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '-h']
23:10:00     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall -h
23:10:01     INFO - Reading from file tmpfile_stdout
23:10:01     INFO - Output received:
23:10:01     INFO -  Usage: mozinstall [options] installer
23:10:01     INFO -  Options:
23:10:01     INFO -    -h, --help            show this help message and exit
23:10:01     INFO -    -d DEST, --destination=DEST
23:10:01     INFO -                          Directory to install application into. [default:
23:10:01     INFO -                          "/Users/cltbld/tasks/task_1536534531"]
23:10:01     INFO -    --app=APP             Application being installed. [default: firefox]
23:10:01     INFO - mkdir: /Users/cltbld/tasks/task_1536534531/build/application
23:10:01     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application']
23:10:01     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1536534531/installer.dmg --destination /Users/cltbld/tasks/task_1536534531/build/application
23:10:05    ERROR - Errors received:
23:10:05     INFO - Reading from file tmpfile_stderr
23:10:05    ERROR -  hdiutil: attach failed - image data corrupted
23:10:05    ERROR -  Traceback (most recent call last):
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall", line 9, in <module>
23:10:05    ERROR -      load_entry_point('mozInstall==1.16.0', 'console_scripts', 'mozinstall')()
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 367, in install_cli
23:10:05    ERROR -      install_path = install(src, options.dest)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 152, in install
23:10:05    ERROR -      reraise(InstallError, error, trbk)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 129, in install
23:10:05    ERROR -      install_dir = _install_dmg(src, dest)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 296, in _install_dmg
23:10:05    ERROR -      for appFile in os.listdir(appDir):
23:10:05    ERROR -  mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1536534531/installer.dmg ([Errno 2] No such file or directory: '')"
23:10:05    ERROR - Return code: 1
23:10:05  WARNING - setting return code to 3
23:10:05    FATAL - Halting on failure while running ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application']
23:10:05    FATAL - Running post_fatal callback...
23:10:05    FATAL - Exiting 3
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE

(In reply to Andreea Pavel [:apavel] from comment #12)

Can you please take a look?

This is unrelated to bug 1547721.

It looks like sometimes the DMG image gets corrupted somewhere. A few weeks ago this happened on one of tcampbell's autoland commits. It seems to affect random revisions.

Flags: needinfo?(jdemooij)
No longer regressed by: 1547721

Jobs that pass and jobs that fail are downloading the same DMG. This seems like an infrastructure problem. Maybe someone with TaskCluster knowledge can figure out which machines the jobs failed on. This seems quite rare though and is probably not worth the time for anyone to dig deeper and see if it goes away.

Next time it happens, it is probably worth re-triggering the build itself and see if that helps.

Status: REOPENED → RESOLVED
Closed: 2 years ago1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 1 year ago10 months ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=263554335&repo=autoland&lineNumber=814

[task 2019-08-26T19:53:18.126Z] 19:53:18 INFO - Starting resource monitoring.
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - [mozharness: 2019-08-26 19:53:18.130421Z] Finished create-virtualenv step (success)
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - [mozharness: 2019-08-26 19:53:18.131143Z] Running install step.
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Running pre-action listener: _resource_record_pre_action
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Running main action method: install
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/pip', 'freeze']
[task 2019-08-26T19:53:18.131Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/pip freeze
[task 2019-08-26T19:53:18.430Z] 19:53:18 INFO - Reading from file tmpfile_stdout
[task 2019-08-26T19:53:18.430Z] 19:53:18 INFO - Reading from file tmpfile_stderr
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Detecting whether we're running mozinstall >=1.0...
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall', '-h']
[task 2019-08-26T19:53:18.431Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall -h
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Reading from file tmpfile_stdout
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Output received:
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Usage: mozinstall [options] installer
[task 2019-08-26T19:53:18.679Z] 19:53:18 INFO - Options:
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - -h, --help show this help message and exit
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - -d DEST, --destination=DEST
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - Directory to install application into. [default:
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - "/Users/cltbld/tasks/task_1566849098"]
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - --app=APP Application being installed. [default: firefox]
[task 2019-08-26T19:53:18.680Z] 19:53:18 INFO - mkdir: /Users/cltbld/tasks/task_1566849098/build/application
[task 2019-08-26T19:53:18.681Z] 19:53:18 INFO - Getting output from command: ['/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1566849098/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1566849098/build/application']
[task 2019-08-26T19:53:18.681Z] 19:53:18 INFO - Copy/paste: /Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1566849098/installer.dmg --destination /Users/cltbld/tasks/task_1566849098/build/application
[task 2019-08-26T19:53:24.856Z] 19:53:24 ERROR - Errors received:
[task 2019-08-26T19:53:24.856Z] 19:53:24 INFO - Reading from file tmpfile_stderr
[task 2019-08-26T19:53:24.856Z] 19:53:24 ERROR - hdiutil: attach failed - image data corrupted
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - Traceback (most recent call last):
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/bin/mozinstall", line 9, in <module>
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - load_entry_point('mozInstall==2.0.0', 'console_scripts', 'mozinstall')()
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 360, in install_cli
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - install_path = install(src, options.dest)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 152, in install
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - reraise(InstallError, error, trbk)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 129, in install
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - install_dir = _install_dmg(src, dest)
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - File "/Users/cltbld/tasks/task_1566849098/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 293, in _install_dmg
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - for appFile in os.listdir(appDir):
[task 2019-08-26T19:53:24.857Z] 19:53:24 ERROR - mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1566849098/installer.dmg ([Errno 2] No such file or directory: '')"
[task 2019-08-26T19:53:24.858Z] 19:53:24 ERROR - Return code: 1

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 10 months ago8 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 8 months ago5 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 5 months ago1 day ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.