Closed Bug 1187691 Opened 10 years ago Closed 9 years ago

funsize-update-generator fails checking MAR signature

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rail, Unassigned)

References

Details

[taskcluster] taskId: HkmmdC2WS4WUB5vnsT_xJg, workerId: i-362938e5 Repository rail/funsize-update-generator already being pulled by another client. Waiting. + test http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar + test http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-26-00-40-10-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar + test linux64 + test en-GB + test nightly + ARTIFACTS_DIR=/home/worker/artifacts + mkdir -p /home/worker/artifacts + /home/worker/bin/funsize.py --artifacts-dir /home/worker/artifacts --from-mar http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar --to-mar http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-26-00-40-10-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar --platform linux64 --locale en-GB --signing-cert /home/worker/keys/nightly.pubkey 2015-07-26 11:29:58,109 - INFO - Refreshing clamav db... 2015-07-26 11:29:58,110 - DEBUG - attempt 1/5 2015-07-26 11:29:58,110 - DEBUG - retry: Calling <function <lambda> at 0x7f0060e989b0> with args: (), kwargs: {}, attempt #1 2015-07-26 11:30:08,773 - INFO - Done. 2015-07-26 11:30:08,775 - DEBUG - Downloading https://hg.mozilla.org/mozilla-central/raw-file/default/tools/update-packaging/unwrap_full_update.pl to /tmp/tmpnbxEo3/unwrap_full_update.pl 2015-07-26 11:30:08,779 - INFO - Starting new HTTPS connection (1): hg.mozilla.org 2015-07-26 11:30:09,702 - DEBUG - "GET /mozilla-central/raw-file/default/tools/update-packaging/unwrap_full_update.pl HTTP/1.1" 200 None 2015-07-26 11:30:09,704 - DEBUG - chmod 755 /tmp/tmpnbxEo3/unwrap_full_update.pl 2015-07-26 11:30:09,705 - DEBUG - Downloading https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mar to /tmp/tmpnbxEo3/mar 2015-07-26 11:30:09,707 - INFO - Starting new HTTPS connection (1): ftp.mozilla.org 2015-07-26 11:30:10,126 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mar HTTP/1.1" 200 19539 2015-07-26 11:30:10,127 - DEBUG - chmod 755 /tmp/tmpnbxEo3/mar 2015-07-26 11:30:10,129 - DEBUG - Downloading https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mbsdiff to /tmp/tmpnbxEo3/mbsdiff 2015-07-26 11:30:10,131 - INFO - Starting new HTTPS connection (1): ftp.mozilla.org 2015-07-26 11:30:10,469 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mbsdiff HTTP/1.1" 200 12837 2015-07-26 11:30:10,470 - DEBUG - chmod 755 /tmp/tmpnbxEo3/mbsdiff 2015-07-26 11:30:10,472 - DEBUG - Downloading http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar to /tmp/tmpnbxEo3/firefox-41.0a2.en-GB.linux-x86_64.complete.mar 2015-07-26 11:30:10,473 - INFO - Starting new HTTP connection (1): download.cdn.mozilla.net 2015-07-26 11:30:10,779 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar HTTP/1.1" 200 55149080 2015-07-26 11:31:47,489 - INFO - Checking /tmp/tmpnbxEo3/firefox-41.0a2.en-GB.linux-x86_64.complete.mar signature 2015-07-26 11:31:47,489 - DEBUG - index_offset is 55147094 Traceback (most recent call last): File "/home/worker/bin/funsize.py", line 236, in <module> main() File "/home/worker/bin/funsize.py", line 182, in main verify_signature(dest, args.signing_cert) File "/home/worker/bin/funsize.py", line 26, in verify_signature m = MarFile(mar, signature_versions=[(1, signature)]) File "/usr/local/lib/python2.7/dist-packages/mardor/marfile.py", line 101, in __init__ self._read_index() File "/usr/local/lib/python2.7/dist-packages/mardor/marfile.py", line 161, in _read_index first_offset = self.members[0]._offset IndexError: list index out of range [taskcluster] Unsuccessful task run with exit code: 1 completed in 128.587 seconds
Haven't seen recently
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → WORKSFORME
https://tools.taskcluster.net/task-inspector/#Dq3rd-kBTRmym8DofYVNAA/0
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---
I checked the file with `mar -T` and it looked fine.
The second rerun worked fine. Sounds like a corrupt file. We should either retry and re-download on this error or check the size against the HTTP response.
Blocks: 1203863
<philor> rail: and for the aurora daily funsize scorecard, tons of 400s, but zero list indexes out of range :)
Status: REOPENED → RESOLVED
Closed: 10 years ago → 9 years ago
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.