Closed Bug 1159548 Opened 10 years ago Closed 10 years ago

B2G builds failing trying to clone from it.mozilla.org

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Type:
defect
Priority:
Not set
Severity:
blocker

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: KWierso, Unassigned)

References

Details

Attachments

(1 file)

[buildbot-configs] Pin to repo v1.12.20
1.39 KB, patch
Details | Diff | Splinter Review
Similar to bug 1150776, b2g builds are trying to clone from it.mozilla.org instead of git.mozilla.org. Not sure where that's getting set. I'm seeing this happen on trunk and b2g release branches.
Looks like the version of repo advanced from 1.12.20 to 1.12.21. The last b2g_b2g-inbound_flame-kk_eng_dep build that succeeded: 13:25:10 INFO - Got revision 9371979628a945a1caf526aeff84a1ac68a22efe 13:25:10 INFO - Return code: 0 13:25:10 INFO - Changing directory to /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000. 13:25:10 INFO - Running command: ['./repo', '--version'] in /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build 13:25:10 INFO - Copy/paste: ./repo --version 13:25:10 INFO - repo version v1.12.20 13:25:10 INFO - (from https://git.mozilla.org/external/google/gerrit/git-repo.git) 13:25:10 INFO - repo launcher version 1.21 13:25:10 INFO - (from /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build/repo) 13:25:10 INFO - git version 1.7.9.4 13:25:10 INFO - Python 2.6.6 (r266:84292, Nov 22 2013, 12:16:22) 13:25:10 INFO - [GCC 4.4.7 20120313 (Red Hat 4.4.7-4)] 13:25:10 INFO - Return code: 0 13:25:10 INFO - Deleting broken projects... 13:25:10 INFO - Running command: ['./repo', 'forall', '-c', 'git show-ref -q --head HEAD || rm -rfv $PWD'] in /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build 13:25:10 INFO - Copy/paste: ./repo forall -c "git show-ref -q --head HEAD || rm -rfv $PWD" 13:32:56 INFO - Return code: 0 The first one to fail: 16:24:07 INFO - Got revision 403b64edf468204597559cf61b346b93af9af232 16:24:07 INFO - Return code: 0 16:24:07 INFO - Changing directory to /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000. 16:24:07 INFO - Running command: ['./repo', '--version'] in /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build 16:24:07 INFO - Copy/paste: ./repo --version 16:24:07 INFO - repo version v1.12.21 16:24:07 INFO - (from https://git.mozilla.org/external/google/gerrit/git-repo.git) 16:24:07 INFO - repo launcher version 1.21 16:24:07 INFO - (from /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build/repo) 16:24:07 INFO - git version 1.7.9.4 16:24:07 INFO - Python 2.6.6 (r266:84292, Nov 22 2013, 12:16:22) 16:24:07 INFO - [GCC 4.4.7 20120313 (Red Hat 4.4.7-4)] 16:24:07 INFO - Return code: 0 16:24:07 INFO - Deleting broken projects... 16:24:07 INFO - Running command: ['./repo', 'forall', '-c', 'git show-ref -q --head HEAD || rm -rfv $PWD'] in /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build 16:24:07 INFO - Copy/paste: ./repo forall -c "git show-ref -q --head HEAD || rm -rfv $PWD" 16:24:07 INFO - Traceback (most recent call last): 16:24:07 INFO - File "/builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build/.repo/repo/main.py", line 506, in <module> 16:24:07 INFO - _Main(sys.argv[1:]) 16:24:07 INFO - File "/builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build/.repo/repo/main.py", line 482, in _Main 16:24:07 INFO - result = repo._Run(argv) or 0 16:24:07 INFO - File "/builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build/.repo/repo/main.py", line 161, in _Run 16:24:07 INFO - result = cmd.Execute(copts, cargs) 16:24:07 INFO - File "/builds/git-shared/repo/repo/subcmds/forall.py", line 200, in Execute 16:24:07 INFO - mirror = self.manifest.IsMirror 16:24:07 INFO - File "/builds/git-shared/repo/repo/manifest_xml.py", line 351, in IsMirror 16:24:07 INFO - return self.manifestProject.config.GetBoolean('repo.mirror') 16:24:07 INFO - File "/builds/git-shared/repo/repo/git_config.py", line 112, in GetBoolean 16:24:07 INFO - v = self.GetString(name) 16:24:07 INFO - File "/builds/git-shared/repo/repo/git_config.py", line 129, in GetString 16:24:07 INFO - v = self._cache[_key(name)] 16:24:07 INFO - File "/builds/git-shared/repo/repo/git_config.py", line 246, in _cache 16:24:07 INFO - self._cache_dict = self._Read() 16:24:07 INFO - File "/builds/git-shared/repo/repo/git_config.py", line 253, in _Read 16:24:07 INFO - self._SaveJson(d) 16:24:07 INFO - File "/builds/git-shared/repo/repo/git_config.py", line 283, in _SaveJson 16:24:07 INFO - if os.path.exists(self.json): 16:24:07 INFO - AttributeError: 'GitConfig' object has no attribute 'json' 16:24:07 ERROR - Return code: 1 We don't stop here and catch this error. And a little latter hit: 16:24:08 INFO - repo has been initialized in /builds/slave/b2g_b2g-in_flm-kk_eng_dep-0000/build 16:25:42 INFO - fatal: 'it.mozilla.org/b2g/platform_bootable_recovery' does not appear to be a git repository 16:25:42 INFO - fatal: The remote end hung up unexpectedly 16:26:20 INFO - fatal: 'it.mozilla.org/b2g/platform_bootable_recovery' does not appear to be a git repository 16:26:20 INFO - fatal: The remote end hung up unexpectedly
Looks like a bug in https://gerrit.googlesource.com/git-repo/+/85b24acd%5E!/#F0 to me, specifically at |os.path.exists(self.json)|, should be self._json. Will look into pinning our repo revision at v1.12.20 until this is resolved upstream.
https://code.google.com/p/git-repo/issues/detail?id=190, the self.json typo has been around since 1.12.17, from January, must be something else in the .20->.21 changes that's throwing us into that broken code.
Builds now get past cloning the manifest contents.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
That busted hazard builds on b2g32 and b2g34 but not b2g37, which probably means RyanVM has to downlift the mozharness rev from bug 1150776 to those two branches, too. Are we ready to tear out the totally unworkable mozharness pinning yet?
I pinned all the B2G repos to the mozharness mozilla-b2g37 branch. Looks like hazard builds are OK again.
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: