Closed Bug 1584217 Opened 2 years ago Closed 2 years ago

Intermittent [taskcluster:error] Task timeout after 3600 seconds. Force killing container.

Categories

(Firefox Build System :: Toolchains, defect, P5)

defect

Tracking

(firefox-esr60 unaffected, firefox-esr68 unaffected, firefox69 unaffected, firefox70 unaffected, firefox71 fixed)

RESOLVED FIXED
mozilla71
Tracking Status
firefox-esr60 --- unaffected
firefox-esr68 --- unaffected
firefox69 --- unaffected
firefox70 --- unaffected
firefox71 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: away)

References

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Filed by: aiakab [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=268549901&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/MfOy4ZeMRQq7s6Nb23w5Zg/runs/1/artifacts/public/logs/live_backing.log


[task 2019-09-26T12:44:23.481Z] [3457/3798] /builds/worker/fetches/llvm-project/build/stage2/clang/bin/clang++ -DGTEST_HAS_RTTI=0 -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -Itools/llvm-dwp -I/builds/worker/fetches/llvm-project/llvm/tools/llvm-dwp -Iinclude -I/builds/worker/fetches/llvm-project/llvm/include -fPIC -Qunused-arguments -gcc-toolchain /builds/worker/fetches/llvm-project/build/stage1/clang -fPIC -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -std=c++11 -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -O3 -DNDEBUG -fno-exceptions -fno-rtti -MD -MT tools/llvm-dwp/CMakeFiles/llvm-dwp.dir/DWPError.cpp.o -MF tools/llvm-dwp/CMakeFiles/llvm-dwp.dir/DWPError.cpp.o.d -o tools/llvm-dwp/CMakeFiles/llvm-dwp.dir/DWPError.cpp.o -c /builds/worker/fetches/llvm-project/llvm/tools/llvm-dwp/DWPError.cpp
[task 2019-09-26T12:44:23.594Z] [3458/3798] /builds/worker/fetches/llvm-project/build/stage2/clang/bin/clang++ -DGTEST_HAS_RTTI=0 -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -Itools/llvm-diff -I/builds/worker/fetches/llvm-project/llvm/tools/llvm-diff -Iinclude -I/builds/worker/fetches/llvm-project/llvm/include -fPIC -Qunused-arguments -gcc-toolchain /builds/worker/fetches/llvm-project/build/stage1/clang -fPIC -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -std=c++11 -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -O3 -DNDEBUG -fno-exceptions -fno-rtti -MD -MT tools/llvm-diff/CMakeFiles/llvm-diff.dir/DiffConsumer.cpp.o -MF tools/llvm-diff/CMakeFiles/llvm-diff.dir/DiffConsumer.cpp.o.d -o tools/llvm-diff/CMakeFiles/llvm-diff.dir/DiffConsumer.cpp.o -c /builds/worker/fetches/llvm-project/llvm/tools/llvm-diff/DiffConsumer.cpp

[taskcluster:error] Task timeout after 3600 seconds. Force killing container.
[taskcluster 2019-09-26 12:44:24.314Z] === Task Finished ===
[taskcluster 2019-09-26 12:44:24.314Z] Unsuccessful task run with exit code: -1 completed in 3630.724 seconds

dmajor can you please take a look?

Flags: needinfo?(dmajor)
See Also: → 1573211

With clang-8 sources, this task was already pretty close to the limit with typical times of 54-58 minutes.

In clang-9, enough new code was added that we're seeing frequent intermittent timeouts. Even the few successful builds come in just under the wire at 60 minutes.

Note for sheriffs, if the clang-9 update gets backed out, this patch can stay, we'll need it anyway.

Pushed by dmajor@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/abc8072a0b3b
Increase the timeout for the clang-aarch64 toolchain r=nalexander
Flags: needinfo?(dmajor)
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla71
You need to log in before you can comment on or make changes to this bug.