Closed Bug 1605226 Opened 5 years ago Closed 5 years ago

Intermittent run bpgo macos [taskcluster:error] Task aborted - max run time exceeded when Gecko 73 merges to Beta on 2020-01-06

Categories

(Testing :: General, defect)

Version 3
defect
Not set
normal

Tracking

(firefox-esr68 unaffected, firefox71 unaffected, firefox72 unaffected, firefox73+ fixed)

RESOLVED DUPLICATE of bug 1601252
Tracking Status
firefox-esr68 --- unaffected
firefox71 --- unaffected
firefox72 --- unaffected
firefox73 + fixed

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure)

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281536334&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Vg1zYfufRcCgMIwsyzbOhA/runs/0/artifacts/public/logs/live_backing.log


[task 2019-12-17T12:44:45.278Z] New python executable in /Users/cltbld/tasks/task_1576586464/checkouts/gecko/obj-x86_64-apple-darwin18.6.0/_virtualenvs/init/bin/python
[task 2019-12-17T12:44:45.278Z] Installing setuptools, pip, wheel...
[task 2019-12-17T12:44:47.534Z] done.
[task 2019-12-17T12:44:49.934Z] running build_ext
[task 2019-12-17T12:44:49.934Z] building 'psutil._psutil_osx' extension
[task 2019-12-17T12:44:49.934Z] creating build
[task 2019-12-17T12:44:49.934Z] creating build/temp.macosx-10.14-intel-2.7
[task 2019-12-17T12:44:49.934Z] creating build/temp.macosx-10.14-intel-2.7/psutil
[task 2019-12-17T12:44:49.934Z] creating build/temp.macosx-10.14-intel-2.7/psutil/arch
[task 2019-12-17T12:44:49.934Z] creating build/temp.macosx-10.14-intel-2.7/psutil/arch/osx
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/_psutil_common.c -o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_common.o
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/_psutil_posix.c -o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_posix.o
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/_psutil_osx.c -o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_osx.o
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/arch/osx/process_info.c -o build/temp.macosx-10.14-intel-2.7/psutil/arch/osx/process_info.o
[task 2019-12-17T12:44:49.934Z] creating build/lib.macosx-10.14-intel-2.7
[task 2019-12-17T12:44:49.934Z] creating build/lib.macosx-10.14-intel-2.7/psutil
[task 2019-12-17T12:44:49.934Z] cc -bundle -undefined dynamic_lookup -Wl,-F. build/temp.macosx-10.14-intel-2.7/psutil/_psutil_common.o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_posix.o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_osx.o build/temp.macosx-10.14-intel-2.7/psutil/arch/osx/process_info.o -o build/lib.macosx-10.14-intel-2.7/psutil/_psutil_osx.so -framework CoreFoundation -framework IOKit
[task 2019-12-17T12:44:49.934Z] building 'psutil._psutil_posix' extension
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/_psutil_common.c -o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_common.o
[task 2019-12-17T12:44:49.934Z] cc -fno-strict-aliasing -fno-common -dynamic -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=563 -DPSUTIL_OSX=1 -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c psutil/_psutil_posix.c -o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_posix.o
[task 2019-12-17T12:44:49.934Z] cc -bundle -undefined dynamic_lookup -Wl,-F. build/temp.macosx-10.14-intel-2.7/psutil/_psutil_common.o build/temp.macosx-10.14-intel-2.7/psutil/_psutil_posix.o -o build/lib.macosx-10.14-intel-2.7/psutil/_psutil_posix.so
[task 2019-12-17T12:44:49.934Z] copying build/lib.macosx-10.14-intel-2.7/psutil/_psutil_osx.so -> psutil
[task 2019-12-17T12:44:49.934Z] copying build/lib.macosx-10.14-intel-2.7/psutil/_psutil_posix.so -> psutil
[task 2019-12-17T12:44:49.934Z]
[task 2019-12-17T12:44:49.934Z] Error processing command. Ignoring because optional. (optional:packages.txt:comm/build/virtualenv_packages.txt)
[task 2019-12-17T12:45:15.840Z] ./mach python build/pgo/profileserver.py --binary $MOZ_FETCHES_DIR/*.app/Contents/MacOS/firefox
[task 2019-12-17T12:45:15.841Z] + ./mach python build/pgo/profileserver.py --binary '/Users/cltbld/tasks/task_1576586464/fetches/Firefox Nightly.app/Contents/MacOS/firefox'
[taskcluster:error] Aborting task...
[taskcluster:warn 2019-12-17T14:41:08.973Z] no such process
[taskcluster 2019-12-17T14:41:08.974Z] === Task Finished ===
[taskcluster 2019-12-17T14:41:08.974Z] Task Duration: 2h0m0.11097032s
[taskcluster 2019-12-17T14:41:09.131Z] Uploading artifact public/build/profile-run-1.log from file artifacts/profile-run-1.log with content encoding "gzip", mime type "text/plain" and expiry 2020-01-14T11:25:54.461Z
[taskcluster 2019-12-17T14:41:09.324Z] [mounts] Preserving cache: Moving "/Users/cltbld/tasks/task_1576586464/checkouts" to "/Users/cltbld/caches/APBJ4zE9TLSddQTP29-D7w"
[taskcluster:error] Task aborted - max run time exceeded

Chris can you take a look?

Flags: needinfo?(cmanchester)
Regressed by: 1528374
See Also: → 1604578
Summary: Intermittent [taskcluster:error] Task aborted - max run time exceeded → Intermittent run bpgo macos [taskcluster:error] Task aborted - max run time exceeded

This failure seems to be hiding another issue, bug 1599369, as per https://bugzilla.mozilla.org/show_bug.cgi?id=1599369#c4 with example in the next comment.

Summary: Intermittent run bpgo macos [taskcluster:error] Task aborted - max run time exceeded → Intermittent run bpgo macos [taskcluster:error] Task aborted - max run time exceeded when Gecko 73 merges to Beta on 2020-01-06

From the profile run log we have 1576586718313 addons.xpi-utils WARN addMetadata: Add-on quitter@mozilla.org is invalid: Error: Extension quitter@mozilla.org is not correctly signed(resource://gre/modules/addons/XPIDatabase.jsm:2703:15) JS Stack trace: addMetadata@XPIDatabase.jsm:2703:15

This looks like a version of bug 1523750, although I'm not sure why the introduction of macOS pgo builds causes this. :kmag, do you have an idea of how this should be fixed? Thanks.

Flags: needinfo?(cmanchester) → needinfo?(kmaglione+bmo)

The issue I'm worried about is the urllib2 error bhearsum reported in bug 1599369 (that's what he was testing in that Try push). I think the timeouts will be solved by the updated quitter extension.

I see. Commented over there.

Flags: needinfo?(kmaglione+bmo)
Priority: P5 → --
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.