Intermittent hdiutil: attach failed - image data corrupted

RESOLVED INCOMPLETE

Status

defect
P5
normal
RESOLVED INCOMPLETE
2 years ago
11 days ago

People

(Reporter: intermittent-bug-filer, Unassigned)

Tracking

({intermittent-failure})

Version 3
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=142132307&repo=autoland

https://queue.taskcluster.net/v1/task/e6jfNHAoR-i5kYg7PP8wlg/runs/0/artifacts/public/logs/live_backing.log

03:33:36     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '-h']
03:33:36     INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall -h
03:33:36     INFO - Reading from file tmpfile_stdout
03:33:36     INFO - Output received:
03:33:36     INFO -  Usage: mozinstall [options] installer
03:33:36     INFO -  Options:
03:33:36     INFO -    -h, --help            show this help message and exit
03:33:36     INFO -    -d DEST, --destination=DEST
03:33:36     INFO -                          Directory to install application into. [default:
03:33:36     INFO -                          "/Users/cltbld/tasks/task_1509782337"]
03:33:36     INFO -    --app=APP             Application being installed. [default: firefox]
03:33:36     INFO - mkdir: /Users/cltbld/tasks/task_1509782337/build/application
03:33:36     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1509782337/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1509782337/build/application']
03:33:36     INFO - Copy/paste: /Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1509782337/installer.dmg --destination /Users/cltbld/tasks/task_1509782337/build/application
03:33:42    ERROR - Errors received:
03:33:42     INFO - Reading from file tmpfile_stderr
03:33:42    ERROR -  hdiutil: attach failed - image data corrupted
03:33:42    ERROR -  Traceback (most recent call last):
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/bin/mozinstall", line 9, in <module>
03:33:42    ERROR -      load_entry_point('mozInstall==1.14', 'console_scripts', 'mozinstall')()
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 368, in install_cli
03:33:42    ERROR -      install_path = install(src, options.dest)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 153, in install
03:33:42    ERROR -      reraise(InstallError, error, trbk)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 130, in install
03:33:42    ERROR -      install_dir = _install_dmg(src, dest)
03:33:42    ERROR -    File "/Users/cltbld/tasks/task_1509782337/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 297, in _install_dmg
03:33:42    ERROR -      for appFile in os.listdir(appDir):
03:33:42    ERROR -  mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1509782337/installer.dmg ([Errno 2] No such file or directory: '')"
03:33:42    ERROR - Return code: 1
03:33:42  WARNING - setting return code to 3
https://wiki.mozilla.org/Bugmasters#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=198354882&repo=autoland&lineNumber=791

Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/pip', 'freeze']
23:10:00     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/pip freeze
23:10:00     INFO - Reading from file tmpfile_stdout
23:10:00     INFO - Detecting whether we're running mozinstall >=1.0...
23:10:00     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '-h']
23:10:00     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall -h
23:10:01     INFO - Reading from file tmpfile_stdout
23:10:01     INFO - Output received:
23:10:01     INFO -  Usage: mozinstall [options] installer
23:10:01     INFO -  Options:
23:10:01     INFO -    -h, --help            show this help message and exit
23:10:01     INFO -    -d DEST, --destination=DEST
23:10:01     INFO -                          Directory to install application into. [default:
23:10:01     INFO -                          "/Users/cltbld/tasks/task_1536534531"]
23:10:01     INFO -    --app=APP             Application being installed. [default: firefox]
23:10:01     INFO - mkdir: /Users/cltbld/tasks/task_1536534531/build/application
23:10:01     INFO - Getting output from command: ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application']
23:10:01     INFO - Copy/paste: /Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall /Users/cltbld/tasks/task_1536534531/installer.dmg --destination /Users/cltbld/tasks/task_1536534531/build/application
23:10:05    ERROR - Errors received:
23:10:05     INFO - Reading from file tmpfile_stderr
23:10:05    ERROR -  hdiutil: attach failed - image data corrupted
23:10:05    ERROR -  Traceback (most recent call last):
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall", line 9, in <module>
23:10:05    ERROR -      load_entry_point('mozInstall==1.16.0', 'console_scripts', 'mozinstall')()
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 367, in install_cli
23:10:05    ERROR -      install_path = install(src, options.dest)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 152, in install
23:10:05    ERROR -      reraise(InstallError, error, trbk)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 129, in install
23:10:05    ERROR -      install_dir = _install_dmg(src, dest)
23:10:05    ERROR -    File "/Users/cltbld/tasks/task_1536534531/build/venv/lib/python2.7/site-packages/mozinstall/mozinstall.py", line 296, in _install_dmg
23:10:05    ERROR -      for appFile in os.listdir(appDir):
23:10:05    ERROR -  mozinstall.mozinstall.InstallError: Failed to install "/Users/cltbld/tasks/task_1536534531/installer.dmg ([Errno 2] No such file or directory: '')"
23:10:05    ERROR - Return code: 1
23:10:05  WARNING - setting return code to 3
23:10:05    FATAL - Halting on failure while running ['/Users/cltbld/tasks/task_1536534531/build/venv/bin/mozinstall', '/Users/cltbld/tasks/task_1536534531/installer.dmg', '--destination', '/Users/cltbld/tasks/task_1536534531/build/application']
23:10:05    FATAL - Running post_fatal callback...
23:10:05    FATAL - Exiting 3
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 2 years ago9 months ago
Resolution: --- → INCOMPLETE

(In reply to Andreea Pavel [:apavel] from comment #12)

Can you please take a look?

This is unrelated to bug 1547721.

It looks like sometimes the DMG image gets corrupted somewhere. A few weeks ago this happened on one of tcampbell's autoland commits. It seems to affect random revisions.

Flags: needinfo?(jdemooij)
No longer regressed by: 1547721

Jobs that pass and jobs that fail are downloading the same DMG. This seems like an infrastructure problem. Maybe someone with TaskCluster knowledge can figure out which machines the jobs failed on. This seems quite rare though and is probably not worth the time for anyone to dig deeper and see if it goes away.

Next time it happens, it is probably worth re-triggering the build itself and see if that helps.

Status: REOPENED → RESOLVED
Closed: 9 months ago3 months ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 3 months ago11 days ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.