Closed Bug 1484790 Opened 3 years ago Closed 3 years ago

Intermittent Exception: ['unzip', '/home/cltbld/fetches/target.jsshell.zip'] exited 1 | unexpected file found, stuck at prompt if it shall be replaced: replace *? [y]es, [n]o, [A]ll, [N]one, [r]ename: NULL

Categories

(Firefox Build System :: Task Configuration, task, P5)

task

Tracking

(firefox63 fixed)

RESOLVED FIXED
mozilla63
Tracking Status
firefox63 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ahal)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=194903936&repo=autoland

https://queue.taskcluster.net/v1/task/ZSNGT7eKSimQepwdUbegTQ/runs/0/artifacts/public/logs/live_backing.log

[vcs 2018-08-20T17:31:37.639Z] WARNING: vcs checkout path (/home/cltbld/checkouts/gecko) not in cache or volume; performance will likely suffer
[vcs 2018-08-20T17:31:37.639Z] WARNING: HG_STORE_PATH (/home/cltbld/checkouts/hg-store) not in cache or volume; performance will likely suffer
[vcs 2018-08-20T17:31:37.640Z] executing ['hg', 'robustcheckout', '--sharebase', '/home/cltbld/checkouts/hg-store', '--purge', '--upstream', 'https://hg.mozilla.org/mozilla-unified', '--revision', 'c218b23035ed1417b50aa32b03cb4145ac44b887', 'https://hg.mozilla.org/integration/autoland', '/home/cltbld/checkouts/gecko']
[vcs 2018-08-20T17:31:37.679Z] (using Mercurial 4.4.1)
[vcs 2018-08-20T17:31:37.679Z] ensuring https://hg.mozilla.org/integration/autoland@c218b23035ed1417b50aa32b03cb4145ac44b887 is available at /home/cltbld/checkouts/gecko
..
..
..
Extracting /home/cltbld/fetches/target.jsshell.zip to /home/cltbld/fetches using ['unzip', '/home/cltbld/fetches/target.jsshell.zip']
Archive:  /home/cltbld/fetches/target.jsshell.zip
replace js? [y]es, [n]o, [A]ll, [N]one, [r]ename:  NULL
(EOF or read error, treating as "[N]one" ...)
Traceback (most recent call last):
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 338, in <module>
    sys.exit(main())
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 334, in main
    return args.func(args)
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 298, in command_task_artifacts
    fetch_urls(downloads)
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 249, in fetch_urls
    f.result()
  File "/usr/lib/python3.5/concurrent/futures/_base.py", line 405, in result
    return self.__get_result()
  File "/usr/lib/python3.5/concurrent/futures/_base.py", line 357, in __get_result
    raise self._exception
  File "/usr/lib/python3.5/concurrent/futures/thread.py", line 55, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 235, in fetch_and_extract
    extract_archive(dest_path, dest_dir, typ)
  File "/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content", line 215, in extract_archive
    raise Exception('%r exited %d' % (args, p.returncode))
Exception: ['unzip', '/home/cltbld/fetches/target.jsshell.zip'] exited 1
Traceback (most recent call last):
  File "./run-task", line 755, in <module>
    sys.exit(main(sys.argv[1:]))
  File "./run-task", line 742, in main
    fetch_artifacts(fetches)
  File "./run-task", line 496, in fetch_artifacts
    subprocess.run(cmd, check=True, env=os.environ)
  File "/usr/lib/python3.5/subprocess.py", line 708, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/home/cltbld/checkouts/gecko/taskcluster/scripts/misc/fetch-content', 'task-artifacts', 'public/build/target.jsshell.zip@Ft86hRbEQOCgpALrlpVqlw', 'public/d8-6.7.17.zip@LcoynlitTteA4BmkQv8CBg', 'public/web-tooling-benchmark-b2ac25c897c9.zip@fvJK7vY6T02i6pSqRNfbOw']' returned non-zero exit status 1
Component: Gecko Profiler → General
Product: Core → Release Engineering
QA Contact: catlee
Component: General → Operations
Product: Release Engineering → Taskcluster
QA Contact: catlee
Summary: Intermittent Exception: ['unzip', '/home/cltbld/fetches/target.jsshell.zip'] exited 1 → Intermittent unexpected file found, stuck at prompt if it shall be replaced: replace *? [y]es, [n]o, [A]ll, [N]one, [r]ename: NULL
Component: Operations → Task Configuration
Product: Taskcluster → Firefox Build System
Summary: Intermittent unexpected file found, stuck at prompt if it shall be replaced: replace *? [y]es, [n]o, [A]ll, [N]one, [r]ename: NULL → Intermittent Exception: ['unzip', '/home/cltbld/fetches/target.jsshell.zip'] exited 1 | unexpected file found, stuck at prompt if it shall be replaced: replace *? [y]es, [n]o, [A]ll, [N]one, [r]ename: NULL
Andrew, is this something you could look at?
Flags: needinfo?(ahal)
run-task is supposed to remove MOZ_FETCHES_DIR at the end, so I'm not sure what conditions cause this to happen. But I guess it wouldn't hurt to change the zip command to overwrite without prompting.
Assignee: nobody → ahal
Status: NEW → ASSIGNED
Flags: needinfo?(ahal)
This also moves the call to 'fetch_artifacts' in run-task down inside the
try/finally block. This way if something goes wrong, we'll still cleanup
MOZ_FETCHES_DIR.
Comment on attachment 9003609 [details]
Bug 1484790 - [fetches] Overwrite without prompting when unzipping an artifact with fetch-content, r=gps

Gregory Szorc [:gps] has approved the revision.
Attachment #9003609 - Flags: review+
Pushed by ahalberstadt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/11f24fdab55c
[fetches] Overwrite without prompting when unzipping an artifact with fetch-content, r=gps
https://hg.mozilla.org/mozilla-central/rev/11f24fdab55c
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla63
You need to log in before you can comment on or make changes to this bug.