737186 - use retry for file downloads

Status: RESOLVED WONTFIX

(Release Engineering :: General, enhancement, P2)

Description

[[e-mail] (:bhearsum)]

Retrying at the Build level would be bad, because it could end up putting even more load on FTP/stage. If we retry at the BuildStep level, with a decent sleep inbetween attempts, that would probably be OK.

Comment 1

[Phil Ringnalda (:philor)]

For those keeping track, this will apparently be happening every single morning.

Comment 2

[Chris AtLee [:catlee]]

Attachment: retry file downloads

so this seems to work when ftp is working correctly. I haven't figured out how to test it when ftp is returning 503 errors.

Comment 3

[Chris AtLee [:catlee]]

Comment on attachment 608472 [details] [diff] [review]
retry file downloads

no, I lie, it doesn't work for talos because we don't have tools checked out.

Comment 4

[Chris AtLee [:catlee]]

This is being handled by mozharness in general. I don't think it's worth addressing in buildbot.