1305775 - Improve logging of download and unpack

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Armen [:armenzg]]

We're hitting some sort of edge case in bug 1305752.

ted: the only thing i can think here is that we're getting some kind of weird HTTP response and the response body is something we didn't expect. I think it'd be a good idea to add some more logging here: https://dxr.mozilla.org/mozilla-central/source/testing/mozharness/mozharness/base/script.py#397
log the response content-type, as well as turn that content-encoding log into an info and log response.getcode() as well.

Comment 1

[Armen [:armenzg]]

Attachment: Bug 1305775 - Output more metadata about files fetched to increase debuggability.

In bug 1305752 we discovered that we download a zip file into memory without any issues, however,
when we tried to unzip we discovered that we have an invalid zip file.

The information in the logs is not sufficient to determine what could be the root issue.

Review commit: https://reviewboard.mozilla.org/r/81460/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/81460/

Comment 2

[(not currently active) Ted Mielczarek]

Comment on attachment 8795404 [details]
Bug 1305775 - Output more metadata about files fetched to increase debuggability.

https://reviewboard.mozilla.org/r/81460/#review80018

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e709712a33e7
Output more metadata about files fetched to increase debuggability. r=ted

Comment 4

[Armen [:armenzg]]

In bug 1305752, we can see about 63 instances of this.
It might all be related to the TC outage there was going on today.
For some magical reason they all have an expected file size of 16970 :)

Unfortunately the latest starred job is before my autolanding. More data tomorrow.

Comment 5

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/e709712a33e7