1160508 - Taskcluster builds seem to sometimes do bad incremental builds

Status: RESOLVED FIXED

(Taskcluster :: General, defect)

Description

[Kartikaya Gupta (email:[e-mail])]

See for example https://treeherder.mozilla.org/logviewer.html#?job_id=7153680&repo=try - this is a try push that appears to have been done incrementally without regenerating headers from ipdl changes, and errored out. The "override" functions were added in bug 1154877.

This may be a build system error but in my experience making changes to ipdl files and then doing a |mach build| locally builds fine, so I'm thinking the problem is with how taskcluster is executing the build.

Comment 1

[Kartikaya Gupta (email:[e-mail])]

The actual try push is at https://treeherder.mozilla.org/#/jobs?repo=try&revision=fbfa5f340d13 (seems like the logviewer page above doesn't link to TH)

Comment 2

[Ryan VanderMeulen [:RyanVM]]

Greg is looking into this too I believe.

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2903155
repository: fx-team
start_time: 2015-05-01T07:45:29
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: 6be8f0db2eea

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_widget1.o] Error 1
make[6]: *** Waiting for unfinished jobs....
make[5]: *** [widget/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9487233
repository: mozilla-inbound
start_time: 2015-05-01T07:51:51
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: e70555ac58d8

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_widget1.o] Error 1
make[6]: *** Waiting for unfinished jobs....
make[5]: *** [widget/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2903563
repository: fx-team
start_time: 2015-05-01T08:14:58
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: da5e75203be5

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_dom_mobilemessage0.o] Error 1
make[5]: *** [dom/mobilemessage/target] Error 2
make[5]: *** Waiting for unfinished jobs....
../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_widget1.o] Error 1
make[5]: *** [widget/target] Error 2
../../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_dom_datastore0.o] Error 1
make[5]: *** [dom/datastore/target] Error 2
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9487411
repository: mozilla-inbound
start_time: 2015-05-01T08:27:27
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: c0b2da7ea0f9

78[1G[J[34m 0:41.76(B[m ../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9487071
repository: mozilla-inbound
start_time: 2015-05-01T08:22:31
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: 130edea98823

78[1G[J[34m 1:49.72(B[m ../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=7158093
repository: try
start_time: 2015-05-01T08:40:23
who: kgupta[at]mozilla[dot]com
machine: unknown
revision: 87ee17824b1c

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_widget1.o] Error 1
make[6]: *** Waiting for unfinished jobs....
make[5]: *** [widget/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2903922
repository: fx-team
start_time: 2015-05-01T08:33:00
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: cb98d773829d

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../dist/include/mozilla/dom/ContentParent.h:796:18: error: 'virtual bool mozilla::dom::ContentParent::RecvCopyFavicon(const URIParams&, const URIParams&, const bool&)' marked override, but does not override
make[6]: *** [Unified_cpp_widget1.o] Error 1
make[6]: *** Waiting for unfinished jobs....
make[5]: *** [widget/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9487597
repository: mozilla-inbound
start_time: 2015-05-01T08:36:49
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: 2f4eb23c6d7c

78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:703:15: error: 'class mozIStorageStatement' has no member named 'BindStringAsBlobParameter'
78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:737:15: error: 'class mozIStorageStatement' has no member named 'BindStringAsBlobParameter'
78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:766:15: error: 'class mozIStorageStatement' has no member named 'BindStringAsBlobParameter'
78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:794:17: error: 'class mozIStorageStatement' has no member named 'GetBlobAsString'
78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:1202:15: error: 'class mozIStorageStatement' has no member named 'BindUTF8StringAsBlobParameter'
78[1G[J[34m 5:43.95(B[m /home/worker/workspace/gecko/dom/cache/DBSchema.cpp:1337:15: error: 'class mozIStorageStatement' has no member named 'GetBlobAsUTF8String'

Comment 11

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9488450
repository: mozilla-inbound
start_time: 2015-05-01T08:45:15
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: 18631c5f8111

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../../../../gecko/dom/events/EventListenerService.h:82:29: error: 'nsIListenerChangeListener' was not declared in this scope
../../../../gecko/dom/events/EventListenerService.h:82:29: error: template argument 1 is invalid
../../../../gecko/dom/events/EventListenerService.h:82:54: error: template argument 1 is invalid
make[6]: *** [Unified_cpp_dom_events0.o] Error 1
make[6]: *** Waiting for unfinished jobs....
make[5]: *** [dom/events/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9488376
repository: mozilla-inbound
start_time: 2015-05-01T08:49:11
who: rvandermeulen[at]mozilla[dot]com
machine: unknown
revision: c6f21d65e5d2

Errors received:
The directory '/home/worker/.cache/pip/log' or its parent directory is not owned by the current user and the debug log has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want the -H flag.
You are using pip version 6.0.8, however version 6.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
../../../../gecko/dom/events/EventListenerService.h:82:29: error: 'nsIListenerChangeListener' was not declared in this scope
../../../../gecko/dom/events/EventListenerService.h:82:29: error: template argument 1 is invalid
../../../../gecko/dom/events/EventListenerService.h:82:54: error: template argument 1 is invalid
../../../../gecko/dom/events/EventListenerService.cpp:309:49: error: 'nsresult mozilla::EventListenerService::AddListenerChangeListener' is not a static member of 'class mozilla::EventListenerService'
../../../../gecko/dom/events/EventListenerService.cpp:309:49: error: 'nsIListenerChangeListener' was not declared in this scope
../../../../gecko/dom/events/EventListenerService.cpp:309:76: error: 'aListener' was not declared in this scope
../../../../gecko/dom/events/EventListenerService.cpp:310:1: error: expected ',' or ';' before '{' token
../../dist/system_wrappers/prclist.h:2:37: error: expected '}' before end of line
../../dist/system_wrappers/prclist.h:2:37: error: expected declaration before end of line
make[6]: *** [Unified_cpp_dom_events1.o] Error 1
make[6]: *** Waiting for unfinished jobs....
../../../../gecko/dom/events/EventListenerService.h:82:29: error: 'nsIListenerChangeListener' was not declared in this scope
../../../../gecko/dom/events/EventListenerService.h:82:29: error: template argument 1 is invalid
../../../../gecko/dom/events/EventListenerService.h:82:54: error: template argument 1 is invalid
make[6]: *** [Unified_cpp_dom_events0.o] Error 1
make[5]: *** [dom/events/target] Error 2
make[5]: *** Waiting for unfinished jobs....
make[4]: *** [compile] Error 2
make[3]: *** [default] Error 2
make[2]: *** [realbuild] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 13

[Selena Deckelmann :selenamarie :selena]

Issue was likely cache/clobber related, and has been fixed for a while.