Closed Bug 1187691 Opened 9 years ago Closed 8 years ago

funsize-update-generator fails checking MAR signature

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rail, Unassigned)

References

Details

[taskcluster] taskId: HkmmdC2WS4WUB5vnsT_xJg, workerId: i-362938e5

Repository rail/funsize-update-generator already being pulled by another client. Waiting.
+ test http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar
+ test http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-26-00-40-10-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar
+ test linux64
+ test en-GB
+ test nightly
+ ARTIFACTS_DIR=/home/worker/artifacts
+ mkdir -p /home/worker/artifacts
+ /home/worker/bin/funsize.py --artifacts-dir /home/worker/artifacts --from-mar http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar --to-mar http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-26-00-40-10-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar --platform linux64 --locale en-GB --signing-cert /home/worker/keys/nightly.pubkey
2015-07-26 11:29:58,109 - INFO - Refreshing clamav db...
2015-07-26 11:29:58,110 - DEBUG - attempt 1/5
2015-07-26 11:29:58,110 - DEBUG - retry: Calling <function <lambda> at 0x7f0060e989b0> with args: (), kwargs: {}, attempt #1
2015-07-26 11:30:08,773 - INFO - Done.
2015-07-26 11:30:08,775 - DEBUG - Downloading https://hg.mozilla.org/mozilla-central/raw-file/default/tools/update-packaging/unwrap_full_update.pl to /tmp/tmpnbxEo3/unwrap_full_update.pl
2015-07-26 11:30:08,779 - INFO - Starting new HTTPS connection (1): hg.mozilla.org
2015-07-26 11:30:09,702 - DEBUG - "GET /mozilla-central/raw-file/default/tools/update-packaging/unwrap_full_update.pl HTTP/1.1" 200 None
2015-07-26 11:30:09,704 - DEBUG - chmod 755 /tmp/tmpnbxEo3/unwrap_full_update.pl
2015-07-26 11:30:09,705 - DEBUG - Downloading https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mar to /tmp/tmpnbxEo3/mar
2015-07-26 11:30:09,707 - INFO - Starting new HTTPS connection (1): ftp.mozilla.org
2015-07-26 11:30:10,126 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mar HTTP/1.1" 200 19539
2015-07-26 11:30:10,127 - DEBUG - chmod 755 /tmp/tmpnbxEo3/mar
2015-07-26 11:30:10,129 - DEBUG - Downloading https://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mbsdiff to /tmp/tmpnbxEo3/mbsdiff
2015-07-26 11:30:10,131 - INFO - Starting new HTTPS connection (1): ftp.mozilla.org
2015-07-26 11:30:10,469 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/latest-mozilla-central/mar-tools/linux64/mbsdiff HTTP/1.1" 200 12837
2015-07-26 11:30:10,470 - DEBUG - chmod 755 /tmp/tmpnbxEo3/mbsdiff
2015-07-26 11:30:10,472 - DEBUG - Downloading http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar to /tmp/tmpnbxEo3/firefox-41.0a2.en-GB.linux-x86_64.complete.mar
2015-07-26 11:30:10,473 - INFO - Starting new HTTP connection (1): download.cdn.mozilla.net
2015-07-26 11:30:10,779 - DEBUG - "GET /pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-00-40-06-mozilla-aurora-l10n/firefox-41.0a2.en-GB.linux-x86_64.complete.mar HTTP/1.1" 200 55149080
2015-07-26 11:31:47,489 - INFO - Checking /tmp/tmpnbxEo3/firefox-41.0a2.en-GB.linux-x86_64.complete.mar signature
2015-07-26 11:31:47,489 - DEBUG - index_offset is 55147094
Traceback (most recent call last):
  File "/home/worker/bin/funsize.py", line 236, in <module>
    main()
  File "/home/worker/bin/funsize.py", line 182, in main
    verify_signature(dest, args.signing_cert)
  File "/home/worker/bin/funsize.py", line 26, in verify_signature
    m = MarFile(mar, signature_versions=[(1, signature)])
  File "/usr/local/lib/python2.7/dist-packages/mardor/marfile.py", line 101, in __init__
    self._read_index()
  File "/usr/local/lib/python2.7/dist-packages/mardor/marfile.py", line 161, in _read_index
    first_offset = self.members[0]._offset
IndexError: list index out of range
[taskcluster] Unsuccessful task run with exit code: 1 completed in 128.587 seconds
Haven't seen recently
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WORKSFORME
https://tools.taskcluster.net/task-inspector/#Dq3rd-kBTRmym8DofYVNAA/0
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---
I checked the file with `mar -T` and it looked fine.
The second rerun worked fine. Sounds like a corrupt file. We should either retry and re-download on this error or check the size against the HTTP response.
Blocks: 1203863
 <philor> rail: and for the aurora daily funsize scorecard, tons of 400s, but zero list indexes out of range :)
Status: REOPENED → RESOLVED
Closed: 9 years ago → 8 years ago
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.