1131591 - Nexus 5 Builds busted

Status: RESOLVED DUPLICATE of bug 1108957

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Carsten Book [:Tomcat]]

seems the nexus 5 builds are busted on mozilla-inbound

https://treeherder.mozilla.org/logviewer.html#?job_id=6461644&repo=mozilla-inbound

06:00 < pmoore> hmmmmm
06:01 < pmoore> that's a pretty ugly crash
06:02 < pmoore> ./repo forall -c "git show-ref -q --head HEAD || rm -rfv $PWD" causing a traceback (repo tool crashing)
06:02 < pmoore> maybe this is a recent mozharness change, let me take a look
06:06 < pmoore> doesn't seem to be
06:06 < pmoore> https://hg.mozilla.org/build/mozharness/rev/1527d06e46bd655eee7b446e7a4d02a60c192c6c#l1.381
06:07 < pmoore> i wonder if we've updated our repo version
06:08 < pmoore> https://code.google.com/p/git-repo/issues/detail?id=190

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=6461644
repository: mozilla-inbound
start_time: 2015-02-10T04:38:35
who: tomcat[at]mozilla[dot]com
machine: bld-linux64-spot-274
buildname: b2g_mozilla-inbound_nexus-5-l_periodic
revision: 2e9984133216

AttributeError: 'GitConfig' object has no attribute 'json'
Return code: 1
../../../gecko/netwerk/dns/GetAddrInfo.cpp:261:72: error: 'android_getaddrinfofornet' was not declared in this scope
make[6]: *** [Unified_cpp_netwerk_dns0.o] Error 1
make[5]: *** [netwerk/dns/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/hammerhead/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 2

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=6461645
repository: mozilla-inbound
start_time: 2015-02-10T04:37:59
who: tomcat[at]mozilla[dot]com
machine: bld-linux64-spot-219
buildname: b2g_mozilla-inbound_nexus-5-l_eng_periodic
revision: 2e9984133216

AttributeError: 'GitConfig' object has no attribute 'json'
Return code: 1
../../../gecko/netwerk/dns/GetAddrInfo.cpp:261:72: error: 'android_getaddrinfofornet' was not declared in this scope
make[6]: *** [Unified_cpp_netwerk_dns0.o] Error 1
make[5]: *** [netwerk/dns/target] Error 2
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/hammerhead/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 3

[Pete Moore [:pmoore][:pete]]

Looks like we are checking out repo from 
https://git.mozilla.org/?p=external/google/gerrit/git-repo.git;a=shortlog;h=refs/heads/stable

See:
http://hg.mozilla.org/build/mozharness/file/cc61099cd96a/scripts/b2g_build.py#l333
http://hg.mozilla.org/build/mozharness/file/cc61099cd96a/scripts/b2g_build.py#l139

It is possible that "stable" has been updated.

A workaround might be to temporarily pin the revision to a known good commit, rather than the head of the stable branch:
http://hg.mozilla.org/build/mozharness/file/cc61099cd96a/scripts/b2g_build.py#l140

Comment 4

[Pete Moore [:pmoore][:pete]]

Looks like we mirror from: https://gerrit.googlesource.com/git-repo/+/stable

(see https://hg.mozilla.org/users/hwine_mozilla.com/repo-sync-configs/file/69f083a22c88/external-google-gerrit-git-repo/config#l6)

Comment 5

[Pete Moore [:pmoore][:pete]]

RyanVM has pointed out to me in IRC that the above error is a red herring, and appears in all the logs. The real error comes afterwards.

Probably we should clean up the repo error too, but that is not the cause of this problem, it seems.

Comment 6

[Carsten Book [:Tomcat]]

(In reply to Pete Moore [:pete][:pmoore] from comment #5)
> RyanVM has pointed out to me in IRC that the above error is a red herring,
> and appears in all the logs. The real error comes afterwards.
> 


backed out Bug 1108957

Comment 7

[Chris Cooper [:coop] (he/him)]

cc-ing catlee based on https://hg.mozilla.org/build/mozharness/rev/cc61099cd96a