B2G device image builds failing with "error: packfile <...> does not match index" (followed by: "Output exceeded 52428800 bytes, remaining output has been truncated (output was 52467067 bytes)")

RESOLVED FIXED

Status

Release Engineering
Release Automation
RESOLVED FIXED
4 years ago
4 years ago

People

(Reporter: zac, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
Today's Aurora Flame engineering builds are failing

https://tbpl.mozilla.org/?tree=Mozilla-Aurora&showall=1&rev=8897bc43f59b

TBPL error reported is:
Return code: 1
Output exceeded 52428800 bytes, remaining output has been truncated (output was 52467067 bytes)
Hitting this on other jobs as well. From the log:

00:19:36     INFO - Deleting broken projects...
00:19:36     INFO - Running command: ['./repo', 'forall', '-c', 'git show-ref -q --head HEAD || rm -rfv $PWD'] in /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build
00:19:36     INFO - Copy/paste: ./repo forall -c "git show-ref -q --head HEAD || rm -rfv $PWD"
00:19:36     INFO -  error: in `forall -c git show-ref -q --head HEAD || rm -rfv $PWD`: [Errno 2] No such file or directory: '/builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/manifests/.git/HEAD'
00:19:36     INFO -  error: manifest missing or unreadable -- please run init
00:19:36    ERROR - Return code: 1
00:19:36     INFO - Running command: ['./config.sh', '-q', 'flame', '/builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/tmp_manifest/flame.xml'] in /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build
00:19:36     INFO - Copy/paste: ./config.sh -q flame /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/tmp_manifest/flame.xml
00:19:36     INFO - Calling ['./config.sh', '-q', 'flame', '/builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/tmp_manifest/flame.xml'] with output_timeout 3300
00:19:36     INFO -  Initialized empty Git repository in /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/tmp_manifest_repo/.git/
00:19:36     INFO -  [master (root-commit) e554572] manifest
00:19:36     INFO -   1 file changed, 147 insertions(+)
00:19:36     INFO -   create mode 100644 flame.xml
00:19:36     INFO -  Get tmp_manifest_repo
00:19:36     INFO -  From tmp_manifest_repo
00:19:36     INFO -   * [new branch]      master     -> origin/master
00:19:36     INFO -  repo has been initialized in /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build
00:20:24     INFO -  error: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack does not match index
00:20:24     INFO -  warning: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack cannot be accessed
00:20:24     INFO -  error: refs/remotes/b2g/froyo does not point to a valid object!
00:20:25     INFO -  error: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack does not match index
00:20:25     INFO -  warning: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack cannot be accessed
00:20:25     INFO -  error: refs/remotes/b2g/gingerbread_rel does not point to a valid object!
00:20:25     INFO -  error: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack does not match index
00:20:25     INFO -  warning: packfile /builds/slave/b2g_m-aurora_flame_eng_ntly-00/build/.repo/projects/kernel.git/objects/pack/pack-9d41936f2e4781349172f605a61854959e55d610.pack cannot be accessed

...

and it goes on and on and on about invalid objects, packs can't be accessed, etc.

I'm going to go out on a limb and say bug 1023477 is responsible.
Blocks: 1023477

Updated

4 years ago
Summary: Flame eng/ Aurora nightly 6/14/2014 failing: Output exceeded 52428800 bytes, remaining output has been truncated (output was 52467067 bytes) → B2G device image builds failing with "error: packfile <...> does not match index" (followed by: "Output exceeded 52428800 bytes, remaining output has been truncated (output was 52467067 bytes)")

Comment 2

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=41669919&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41669841&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41666403&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41663987&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41666324&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41665455&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41662282&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41668062&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=41662221&tree=B2g-Inbound

Comment 3

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=41670775&tree=B2g-Inbound

Comment 4

4 years ago
Ah, I knew I'd seen a non-try instance of this, thought I'd imagined it earlier:
Linux x86-64 b2g-inbound leak test spidermonkey_tier_1-generational build on 2014-06-13 01:58:57 PDT for push 70db6504787a
slave: bld-linux64-spot-112
https://tbpl.mozilla.org/php/getParsedLog.php?id=41663100&tree=B2g-Inbound
According to Rail - the regressing patch should be backed out now. Simone has respun the Flame eng. build.
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
After rolling back to older AMI's, the respun Nightly Flame completed successfully.
You need to log in before you can comment on or make changes to this bug.