Closed Bug 1736977 Opened 3 years ago Closed 3 years ago

Intermittent [taskcluster:error] Task timeout after 1800 seconds. Force killing container. for Diffoscope opt Task

Categories

(Firefox Build System :: Toolchains, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1736970

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=355546712&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SEG1-NRXSRazCF68qJxTDg/runs/3/artifacts/public/logs/live_backing.log


[taskcluster 2021-10-21 06:45:52.884Z] Task ID: SEG1-NRXSRazCF68qJxTDg
[taskcluster 2021-10-21 06:45:52.884Z] Worker ID: i-00f59716cce6474ba
[taskcluster 2021-10-21 06:45:52.884Z] Worker Group: us-east-1
[taskcluster 2021-10-21 06:45:52.884Z] Worker Node Type: m5dn.4xlarge
[taskcluster 2021-10-21 06:45:52.884Z] Worker Type: b-linux
[taskcluster 2021-10-21 06:45:52.884Z] Public IP: 34.227.84.57
[taskcluster 2021-10-21 06:45:52.884Z] Hostname: ip-10-145-18-106

[taskcluster 2021-10-21 06:45:53.374Z] Downloading artifact "public/image.tar.zst" from task ID: RjouaG6SQP-RwicC4R1kpw.
[taskcluster 2021-10-21 06:45:57.943Z] Downloaded artifact successfully.
[taskcluster 2021-10-21 06:45:57.944Z] Downloaded 391.815 mb
[taskcluster 2021-10-21 06:45:57.944Z] Decompressing downloaded image
[taskcluster 2021-10-21 06:45:59.523Z] Loading docker image from downloaded archive.
[taskcluster 2021-10-21 06:46:05.415Z] Image 'public/image.tar.zst' from task 'RjouaG6SQP-RwicC4R1kpw' loaded.  Using image ID sha256:b5c84ecdc9956878b827f7a180ea0b31a4ea23b367d6597cd0e434f82e51dc40.
[taskcluster 2021-10-21 06:46:05.623Z] === Task Starting ===
[setup 2021-10-21T06:46:06.034Z] run-task started in /builds/worker
[volume 2021-10-21T06:46:06.036Z] changing ownership of volume /builds/worker/checkouts to 1000:1000
[volume 2021-10-21T06:46:06.036Z] changing ownership of volume /builds/worker/tooltool-cache to 1000:1000
[volume 2021-10-21T06:46:06.036Z] changing ownership of volume /builds/worker/workspace to 1000:1000
[setup 2021-10-21T06:46:06.036Z] running as worker:worker
[task 2021-10-21T06:46:06.036Z] executing ['bash', '-cx', '/builds/worker/bin/get_and_diffoscope --fail']
[task 2021-10-21T06:46:06.037Z] + /builds/worker/bin/get_and_diffoscope --fail
[task 2021-10-21T06:46:06.038Z] + cd /builds/worker
[task 2021-10-21T06:46:06.038Z] + mkdir a b
[task 2021-10-21T06:46:06.039Z] + export PATH=/builds/worker/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
[task 2021-10-21T06:46:06.039Z] + PATH=/builds/worker/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
[task 2021-10-21T06:46:06.039Z] + case "$ORIG_URL" in
[task 2021-10-21T06:46:06.040Z] + curl -L https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/McDirCZ0RHOd_9YKFFa_0g/artifacts/public/build/target.tar.bz2
[task 2021-10-21T06:46:06.040Z] + tar -C a -jxf -
[task 2021-10-21T06:46:06.045Z]   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
[task 2021-10-21T06:46:06.046Z]                                  Dload  Upload   Total   Spent    Left  Speed
[task 2021-10-21T06:46:06.046Z] 
[task 2021-10-21T06:46:06.138Z]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[task 2021-10-21T06:46:06.138Z] 100   134  100   134    0     0   1456      0 --:--:-- --:--:-- --:--:--  1456
[task 2021-10-21T06:46:06.890Z] 
[task 2021-10-21T06:46:07.917Z]   7 80.4M    7 6321k    0     0  7490k      0  0:00:10 --:--:--  0:00:10 7490k
[task 2021-10-21T06:46:09.018Z]  17 80.4M   17 13.6M    0     0  7492k      0  0:00:10  0:00:01  0:00:09 7501k
[task 2021-10-21T06:46:09.940Z]  28 80.4M   28 22.7M    0     0  7823k      0  0:00:10  0:00:02  0:00:08 7955k
[task 2021-10-21T06:46:11.064Z]  37 80.4M   37 30.2M    0     0  7951k      0  0:00:10  0:00:03  0:00:07 8081k
[task 2021-10-21T06:46:11.938Z]  48 80.4M   48 39.2M    0     0  8010k      0  0:00:10  0:00:05  0:00:05 8115k
[task 2021-10-21T06:46:12.939Z]  58 80.4M   58 46.7M    0     0  8127k      0  0:00:10  0:00:05  0:00:05 8234k
[task 2021-10-21T06:46:14.113Z]  67 80.4M   67 54.2M    0     0  8066k      0  0:00:10  0:00:06  0:00:04 8280k
[task 2021-10-21T06:46:14.877Z]  74 80.4M   74 60.3M    0     0  7656k      0  0:00:10  0:00:08  0:00:02 7560k
[task 2021-10-21T06:46:15.968Z]  82 80.4M   82 66.3M    0     0  7691k      0  0:00:10  0:00:08  0:00:02 7484k
[task 2021-10-21T06:46:16.891Z]  91 80.4M   91 73.8M    0     0  7619k      0  0:00:10  0:00:09  0:00:01 7218k
[task 2021-10-21T06:46:16.892Z] 100 80.4M  100 80.4M    0     0  7594k      0  0:00:10  0:00:10 --:--:-- 6960k
[task 2021-10-21T06:46:16.892Z] 100 80.4M  100 80.4M    0     0  7594k      0  0:00:10  0:00:10 --:--:-- 6771k
[task 2021-10-21T06:46:16.909Z] + curl -L https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dHxNSSB7T5iiVxoab_sAAQ/artifacts/public/build/target.tar.bz2
[task 2021-10-21T06:46:16.910Z] + tar -C b -jxf -
[task 2021-10-21T06:46:16.915Z]   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
[task 2021-10-21T06:46:16.915Z]                                  Dload  Upload   Total   Spent    Left  Speed
[task 2021-10-21T06:46:16.915Z] 
[task 2021-10-21T06:46:17.005Z]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[task 2021-10-21T06:46:17.005Z] 100   134  100   134    0     0   1488      0 --:--:-- --:--:-- --:--:--  1488
[task 2021-10-21T06:46:18.041Z] 
[task 2021-10-21T06:46:18.899Z]   9 80.4M    9 8024k    0     0  7126k      0  0:00:11  0:00:01  0:00:10 7126k
[task 2021-10-21T06:46:19.913Z]  18 80.4M   18 14.5M    0     0  7509k      0  0:00:10  0:00:01  0:00:09 8003k
[task 2021-10-21T06:46:20.872Z]  28 80.4M   28 22.8M    0     0  7788k      0  0:00:10  0:00:02  0:00:08 8181k
[task 2021-10-21T06:46:21.983Z]  38 80.4M   38 30.7M    0     0  7968k      0  0:00:10  0:00:03  0:00:07 8300k
[task 2021-10-21T06:46:23.035Z]  49 80.4M   49 40.1M    0     0  8121k      0  0:00:10  0:00:05  0:00:05 8403k
[task 2021-10-21T06:46:24.130Z]  60 80.4M   60 48.4M    0     0  8113k      0  0:00:10  0:00:06  0:00:04 8334k
[task 2021-10-21T06:46:25.026Z]  68 80.4M   68 55.0M    0     0  7816k      0  0:00:10  0:00:07  0:00:03 7934k
[task 2021-10-21T06:46:25.983Z]  75 80.4M   75 60.6M    0     0  7662k      0  0:00:10  0:00:08  0:00:02 7588k
[task 2021-10-21T06:46:26.936Z]  83 80.4M   83 67.4M    0     0  7614k      0  0:00:10  0:00:09  0:00:01 7341k
[task 2021-10-21T06:46:27.781Z]  92 80.4M   92 74.2M    0     0  7583k      0  0:00:10  0:00:10 --:--:-- 7032k
[task 2021-10-21T06:46:27.781Z] 100 80.4M  100 80.4M    0     0  7585k      0  0:00:10  0:00:10 --:--:-- 6905k
[task 2021-10-21T06:46:27.801Z] + case "$ORIG_URL" in
[task 2021-10-21T06:46:27.801Z] + OMNIJAR=omni.ja
[task 2021-10-21T06:46:27.801Z] + POST=true
[task 2021-10-21T06:46:27.801Z] + for option in "$@"
[task 2021-10-21T06:46:27.801Z] + case "$option" in
[task 2021-10-21T06:46:27.801Z] + POST=fail
[task 2021-10-21T06:46:27.801Z] + '[' -n '' ']'
[task 2021-10-21T06:46:27.801Z] + diffoscope --html diff.html --text diff.txt --progress --output-empty --no-default-limits --max-page-size 100000000 --max-page-diff-block-lines 10000 --exclude-directory-metadata=yes --exclude-command .--line-numbers a b
[task 2021-10-21T06:46:27.917Z]  |                          |    0%                             ETA:  --:--:-- 
[task 2021-10-21T06:46:27.927Z]  |                           |    0%  a/firefox/application.ini  ETA:  0:34:53 
[task 2021-10-21T06:46:27.929Z]  |                           |    0%          a/firefox/browser  ETA:  0:36:16 
[task 2021-10-21T06:46:27.930Z]  |                |    0%  …ns/default/default16.png  ETA:  305 days, 22:04:39 
[task 2021-10-21T06:46:27.931Z]  |                |    0%  …ns/default/default32.png  ETA:  304 days, 16:57:47 
[task 2021-10-21T06:46:27.932Z]  |                |    0%  …ns/default/default48.png  ETA:  293 days, 21:24:26 
[task 2021-10-21T06:46:27.933Z]  |                |    0%  …ns/default/default64.png  ETA:  272 days, 10:54:28 
[task 2021-10-21T06:46:27.933Z]  |                |    0%                             ETA:  247 days, 16:27:27 
[task 2021-10-21T06:46:27.933Z]  |                |    0%                             ETA:  247 days, 23:26:50 
[task 2021-10-21T06:46:27.933Z]  |                 |    0%                             ETA:  175 days, 8:31:33 
[task 2021-10-21T06:46:27.936Z]  |                |    0%  …ashreporter-override.ini  ETA:  143 days, 10:26:02 
[task 2021-10-21T06:46:27.938Z]  |                |    0%  …firefox/browser/features  ETA:  132 days, 10:03:15 
[task 2021-10-21T06:46:27.942Z]  |                |    0%  …autofill@mozilla.org.xpi  ETA:  5433 days, 0:26:51 
[task 2021-10-21T06:46:27.944Z]  |                 |    0%  …npicture@mozilla.org.xpi  ETA:  816 days, 1:11:57 
[task 2021-10-21T06:46:27.946Z]  |                |    0%  …failover@mozilla.com.xpi  ETA:  763 days, 23:32:11 
[task 2021-10-21T06:46:27.951Z]  |                |    0%  …eenshots@mozilla.org.xpi  ETA:  704 days, 17:15:18 
[task 2021-10-21T06:46:27.953Z]  |                 |    0%  …reporter@mozilla.org.xpi  ETA:  292 days, 2:21:06 
[task 2021-10-21T06:46:27.958Z]  |                 |    0%  …ebcompat@mozilla.org.xpi  ETA:  285 days, 7:19:14 
[task 2021-10-21T06:46:27.958Z]  |                |    0%                             ETA:  201 days, 11:53:14 
[task 2021-10-21T06:46:27.993Z]  |                |    0%  a/firefox/browser/omni.ja  ETA:  201 days, 20:31:55 
[task 2021-10-21T06:46:27.993Z]  |                           |    0%                             ETA:  1:20:35 
[task 2021-10-21T06:46:27.998Z]  |                           |    0%    a/firefox/crashreporter  ETA:  1:20:43 
[task 2021-10-21T06:46:28.003Z]  |                           |    0%  …irefox/crashreporter.ini  ETA:  0:01:43 
[task 2021-10-21T06:46:28.010Z]  |                           |    0%         a/firefox/defaults  ETA:  0:01:45 
[task 2021-10-21T06:46:28.010Z]  |                           |    0%                             ETA:  0:01:49 
[task 2021-10-21T06:46:28.010Z]  |                           |    0%                             ETA:  0:01:50 
[task 2021-10-21T06:46:28.015Z]  |                           |    0%  …refox/dependentlibs.list  ETA:  0:01:50 
[task 2021-10-21T06:46:28.018Z]  |                           |    0%           a/firefox/dmd.py  ETA:  0:01:54 
[task 2021-10-21T06:46:28.019Z]  |                           |    0%          a/firefox/firefox  ETA:  0:01:44 
[task 2021-10-21T06:46:28.028Z]  |                           |    0%      a/firefox/firefox-bin  ETA:  0:01:39 
[task 2021-10-21T06:46:28.031Z]  |                           |    0%    a/firefox/fix_stacks.py  ETA:  0:00:28 
[task 2021-10-21T06:46:28.041Z]  |                           |    0%            a/firefox/fonts  ETA:  0:00:28 
[task 2021-10-21T06:46:28.041Z]  |                           |    0%                             ETA:  0:00:30 
[task 2021-10-21T06:46:28.046Z]  |                           |    0%     a/firefox/gmp-clearkey  ETA:  0:00:30 
[task 2021-10-21T06:46:28.047Z]  |                           |    0%  …earkey/0.1/manifest.json  ETA:  0:00:31 
[task 2021-10-21T06:46:28.047Z]  |                           |    0%                             ETA:  0:00:31 
[task 2021-10-21T06:46:28.047Z]  |                           |    0%                             ETA:  0:00:31 
[task 2021-10-21T06:46:28.048Z]  |                           |    0%            a/firefox/icons  ETA:  0:00:31 
[task 2021-10-21T06:46:28.048Z]  |                           |    0%                             ETA:  0:00:31 
[task 2021-10-21T06:46:28.056Z]  |                           |    0%  …irefox/libfreeblpriv3.so  ETA:  0:00:31 
[task 2021-10-21T06:46:28.057Z]  |                           |    0%   a/firefox/liblgpllibs.so  ETA:  0:00:19 
[task 2021-10-21T06:46:28.067Z]  |                           |    0%  …firefox/libmozavcodec.so  ETA:  0:00:19 
[task 2021-10-21T06:46:28.072Z]  |                           |    1%  a/firefox/libmozavutil.so  ETA:  0:00:09 
[task 2021-10-21T06:46:28.073Z]  |                           |    2%     a/firefox/libmozgtk.so  ETA:  0:00:09 
[task 2021-10-21T06:46:28.076Z]  |                           |    2%  …firefox/libmozsandbox.so  ETA:  0:00:09 
[task 2021-10-21T06:46:28.086Z]  |                           |    2%  …firefox/libmozsqlite3.so  ETA:  0:00:09 
[task 2021-10-21T06:46:28.088Z]  |                           |    2%  …firefox/libmozwayland.so  ETA:  0:00:07 
[task 2021-10-21T06:46:28.092Z]  |                           |    2%      a/firefox/libnspr4.so  ETA:  0:00:07 
[task 2021-10-21T06:46:28.099Z]  |                           |    2%       a/firefox/libnss3.so  ETA:  0:00:07 
[task 2021-10-21T06:46:28.105Z]  |                           |    3%    a/firefox/libnssckbi.so  ETA:  0:00:07 
[task 2021-10-21T06:46:28.109Z]  |                           |    3%   a/firefox/libnssutil3.so  ETA:  0:00:06 
[task 2021-10-21T06:46:28.110Z]  |                           |    3%       a/firefox/libplc4.so  ETA:  0:00:06 
[task 2021-10-21T06:46:28.111Z]  |                           |    3%      a/firefox/libplds4.so  ETA:  0:00:06 
[task 2021-10-21T06:46:28.115Z]  |                           |    3%     a/firefox/libsmime3.so  ETA:  0:00:06 
[task 2021-10-21T06:46:28.120Z]  |                           |    3%   a/firefox/libsoftokn3.so  ETA:  0:00:06 
[task 2021-10-21T06:46:28.125Z]  |                           |    3%       a/firefox/libssl3.so  ETA:  0:00:06 
[task 2021-10-21T06:47:44.072Z]  |#                          |    3%        a/firefox/libxul.so  ETA:  0:00:06 
[task 2021-10-21T06:47:44.489Z]  |#                          |    6%  …ox/libxul.so [.gnu.hash]  ETA:  0:17:36 
[task 2021-10-21T06:47:49.642Z]  |##                         |    9%  …efox/libxul.so [.dynstr]  ETA:  0:11:56 
[task 2021-10-21T06:47:50.832Z]  |###                        |   12%  …ul.so [.elfhack.data.v0]  ETA:  0:09:27 
[task 2021-10-21T06:47:51.143Z]  |####                       |   15%  …ul.so [.elfhack.text.v0]  ETA:  0:07:30 
[task 2021-10-21T06:47:51.447Z]  |####                       |   18%  …irefox/libxul.so [.init]  ETA:  0:06:07 
[task 2021-10-21T06:47:51.971Z]  |#####                      |   21%  …firefox/libxul.so [.plt]  ETA:  0:05:06 
[task 2021-10-21T06:47:52.306Z]  |######                     |   24%  …fox/libxul.so [.plt.got]  ETA:  0:04:21 
[task 2021-10-21T06:55:24.639Z]  |#######                    |   27%  …irefox/libxul.so [.text]  ETA:  0:03:45 
[task 2021-10-21T06:55:25.023Z]  |########                   |   30%  …fox/libxul.so [text_env]  ETA:  0:20:39 
[task 2021-10-21T06:55:25.315Z]  |########                   |   33%  …irefox/libxul.so [.fini]  ETA:  0:18:02 
[task 2021-10-21T06:55:50.673Z]  |#########                  |   36%  …efox/libxul.so [.rodata]  ETA:  0:15:51 
[task 2021-10-21T06:55:53.271Z]  |##########                 |   39%  …ibxul.so [.eh_frame_hdr]  ETA:  0:14:39 
[task 2021-10-21T06:56:06.086Z]  |###########                |   41%  …ox/libxul.so [.eh_frame]  ETA:  0:13:01 
[task 2021-10-21T06:56:06.123Z]  |############               |   44%  …l.so [.gcc_except_table]  ETA:  0:11:49 
[task 2021-10-21T06:56:06.144Z]  |############               |   47%  …refox/libxul.so [.tdata]  ETA:  0:10:30 
[task 2021-10-21T06:56:06.164Z]  |#############              |   50%  …irefox/libxul.so [.tbss]  ETA:  0:09:20 
[task 2021-10-21T06:56:06.184Z]  |##############             |   53%  …/libxul.so [.init_array]  ETA:  0:08:18 
[task 2021-10-21T06:56:06.203Z]  |###############            |   56%  …/libxul.so [.fini_array]  ETA:  0:07:22 
[task 2021-10-21T06:56:11.293Z]  |################           |   59%  …libxul.so [.data.rel.ro]  ETA:  0:06:32 
[task 2021-10-21T06:56:11.417Z]  |################           |   62%  …firefox/libxul.so [.got]  ETA:  0:05:49 
[task 2021-10-21T06:56:11.461Z]  |#################          |   65%  …fox/libxul.so [.got.plt]  ETA:  0:05:07 
[task 2021-10-21T06:56:11.746Z]  |##################         |   68%  …irefox/libxul.so [.data]  ETA:  0:04:29 
[task 2021-10-21T06:56:11.769Z]  |###################        |   71%  …firefox/libxul.so [.bss]  ETA:  0:03:54 
[task 2021-10-21T06:56:11.789Z]  |####################       |   74%  …fox/libxul.so [.comment]  ETA:  0:03:22 
[task 2021-10-21T06:56:11.811Z]  |####################       |   77%  …bxul.so [.gnu_debuglink]  ETA:  0:02:52 
[task 2021-10-21T06:56:45.495Z]  |#####################      |   80%  …efox/libxul.so [.strtab]  ETA:  0:02:24 
[task 2021-10-21T06:56:45.526Z]  |######################     |   83%  …ox/libxul.so [.shstrtab]  ETA:  0:02:05 
[task 2021-10-21T06:56:45.526Z]  |#######################    |   86%                             ETA:  0:01:40 
[task 2021-10-21T06:56:45.536Z]  |#######################    |   86%  …irefox/minidump-analyzer  ETA:  0:01:40 
[task 2021-10-21T06:56:45.562Z]  |#######################    |   86%          a/firefox/omni.ja  ETA:  0:01:33 
[task 2021-10-21T06:56:45.571Z]  |########################## |   99%       a/firefox/pingsender  ETA:  0:00:05 
[task 2021-10-21T06:56:45.578Z]  |########################## |   99%     a/firefox/platform.ini  ETA:  0:00:02 
[task 2021-10-21T06:56:45.585Z]  |########################## |   99%  …firefox/plugin-container  ETA:  0:00:02 
[task 2021-10-21T06:56:45.592Z]  |########################## |   99%      a/firefox/precomplete  ETA:  0:00:00 
[task 2021-10-21T06:56:45.594Z]  |########################## |   99%    a/firefox/removed-files  ETA:  0:00:00 
[task 2021-10-21T06:56:45.600Z]  |########################## |   99%  …efox/update-settings.ini  ETA:  0:00:00 
[task 2021-10-21T06:56:45.603Z]  |########################## |   99%          a/firefox/updater  ETA:  0:00:00 
[task 2021-10-21T06:56:45.606Z]  |########################## |   99%      a/firefox/updater.ini  ETA:  0:00:00 
[task 2021-10-21T06:56:45.606Z]  |###########################|  100%                             ETA:  0:00:00 
[task 2021-10-21T06:56:45.607Z]  |###########################|  100%                             ETA:  0:00:00 
[task 2021-10-21T06:56:45.607Z]  |###########################|  100%                             ETA:  0:00:00 

[taskcluster:error] Task timeout after 1800 seconds. Force killing container.
[taskcluster 2021-10-21 07:16:05.942Z] === Task Finished ===
[taskcluster 2021-10-21 07:16:05.943Z] Unsuccessful task run with exit code: -1 completed in 1813.06 seconds

Glandium, can you please take a look here, this is a Perma failure on Central.

Flags: needinfo?(mh+mozilla)

Most probably a dupe of bug 1736970, but with so many differences that it takes too long to create the output.

Status: NEW → RESOLVED
Closed: 3 years ago
Flags: needinfo?(mh+mozilla)
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.