1194420 - [taskclsuter-vcs] Tar operations should be done serially

Status: RESOLVED FIXED

(Taskcluster :: General, defect)

Description

[Greg Arndt [:garndt]]

Currently taskcluster-vcs will attempt to extract all the repo tarballs in parallel causing interesting race conditions.  Tarballs that are extracting to the same parent directories should not be done in parallel

Comment 1

[Greg Arndt [:garndt]]

Attachment: tc-vcs PR 22

So I've ran this a bunch of times with no errors from tar any longer.  It does take abouta  minute longer, but that's a small price to pay for it to be correct.

Also removed the handling of removing corrupted tarballs, this really should be handled by purging worker caches and so far I have yet to see this be an issue.  Perhaps we will see some errors now and be able to attack the root cause.

Comment 2

[Jonas Finnemann Jensen (:jonasfj)]

Comment on attachment 8647688 [details] [review]
tc-vcs PR 22

See comments, I think this sound.
But we could potentially do faster.

Comment 3

[Greg Arndt [:garndt]]

Merged https://github.com/taskcluster/taskcluster-vcs/commit/b04c6b5b759acd8a0bbe46d92a4eb0b79e1910fa