Closed Bug 1841436 Opened 3 years ago Closed 2 years ago

Perma perftest linux-webpagetest [tier 2] [taskcluster:error] Task aborted - max run time exceeded

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=421281214&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/FNjC7XW6Tc6SjBmCt5lrww/runs/0/artifacts/public/logs/live_backing.log

[fetches 2023-07-02T05:41:12.849Z] /home/cltbld/tasks/task_168827647005583/fetches/target.xpcshell.tests.tar.gz extracted in 0.900s
[fetches 2023-07-02T05:41:12.849Z] Removing /home/cltbld/tasks/task_168827647005583/fetches/target.xpcshell.tests.tar.gz
[fetches 2023-07-02T05:41:13.572Z] /home/cltbld/tasks/task_168827647005583/fetches/target.perftests.tests.tar.gz extracted in 1.448s
[fetches 2023-07-02T05:41:13.572Z] Removing /home/cltbld/tasks/task_168827647005583/fetches/target.perftests.tests.tar.gz
[fetches 2023-07-02T05:41:14.155Z] /home/cltbld/tasks/task_168827647005583/fetches/target.common.tests.tar.gz extracted in 1.841s
[fetches 2023-07-02T05:41:14.155Z] Removing /home/cltbld/tasks/task_168827647005583/fetches/target.common.tests.tar.gz
[fetches 2023-07-02T05:41:21.917Z] /home/cltbld/tasks/task_168827647005583/fetches/target.tar.bz2 extracted in 9.573s
[fetches 2023-07-02T05:41:21.917Z] Removing /home/cltbld/tasks/task_168827647005583/fetches/target.tar.bz2
[fetches 2023-07-02T05:41:21.929Z] PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 10.472908344999993, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2023-07-02T05:41:21.950Z] finished fetching artifacts
[task 2023-07-02T05:41:21.950Z] executing ['bash', '-cx', 'mkdir -p $MOZ_FETCHES_DIR/../artifacts && cd $MOZ_FETCHES_DIR && python3.8 python/mozperftest/mozperftest/runner.py testing/performance/perftest_WPT_firefox_init_file.js --flavor=webpagetest --webpagetest --perfherder --perfherder-metrics median --perfherder-app=firefox --output $MOZ_FETCHES_DIR/../artifacts']
[task 2023-07-02T05:41:21.952Z] + mkdir -p /home/cltbld/tasks/task_168827647005583/fetches/../artifacts
[task 2023-07-02T05:41:21.953Z] + cd /home/cltbld/tasks/task_168827647005583/fetches
[task 2023-07-02T05:41:21.953Z] + python3.8 python/mozperftest/mozperftest/runner.py testing/performance/perftest_WPT_firefox_init_file.js --flavor=webpagetest --webpagetest --perfherder --perfherder-metrics median --perfherder-app=firefox --output /home/cltbld/tasks/task_168827647005583/fetches/../artifacts
[task 2023-07-02T05:41:24.717Z]  0:01.67 Created profile at /tmp/tmpoa2ka3nk.mozrunner
[task 2023-07-02T05:41:25.236Z]  0:02.18 Test queue at ec2-us-east-1(Virginia - EC2) is 374
[task 2023-07-02T05:41:25.236Z]  0:02.18 Testing: google.com
[task 2023-07-02T05:41:25.239Z]  0:02.19 Testing: youtube.com
[task 2023-07-02T05:41:25.240Z]  0:02.19 Testing: facebook.com
[task 2023-07-02T05:41:25.245Z]  0:02.19 Testing: qq.com
[task 2023-07-02T05:41:25.248Z]  0:02.20 Testing: baidu.com
[task 2023-07-02T05:41:25.251Z]  0:02.20 Testing: sohu.com
[task 2023-07-02T05:41:25.255Z]  0:02.20 Testing: 360.cn
[task 2023-07-02T05:41:25.261Z]  0:02.21 Testing: jd.com
[task 2023-07-02T05:41:25.263Z]  0:02.21 Testing: amazon.com
[task 2023-07-02T05:41:25.267Z]  0:02.22 Testing: yahoo.com
[task 2023-07-02T05:41:25.269Z]  0:02.22 Testing: zoom.us
[task 2023-07-02T05:41:25.272Z]  0:02.22 Testing: sina.com.cn
[task 2023-07-02T05:41:25.276Z]  0:02.22 Testing: live.com
[task 2023-07-02T05:41:25.278Z]  0:02.23 Testing: reddit.com
[task 2023-07-02T05:41:25.283Z]  0:02.23 Testing: netflix.com
[task 2023-07-02T05:41:25.284Z]  0:02.23 Testing: microsoft.com
[task 2023-07-02T05:41:25.289Z]  0:02.24 Testing: instagram.com
[task 2023-07-02T05:41:25.290Z]  0:02.24 Testing: google.com.hk
[task 2023-07-02T05:41:25.295Z]  0:02.24 Testing: csdn.net
[task 2023-07-02T05:41:25.300Z]  0:02.25 Testing: bing.com
[task 2023-07-02T05:41:25.303Z]  0:02.25 Testing: vk.com
[task 2023-07-02T05:41:25.303Z]  0:02.25 Testing: yahoo.co.jp
[task 2023-07-02T05:41:25.306Z]  0:02.25 Testing: twitter.com
[task 2023-07-02T05:41:25.311Z]  0:02.26 Testing: naver.com
[task 2023-07-02T05:41:25.315Z]  0:02.26 Testing: canva.com
[task 2023-07-02T05:41:25.318Z]  0:02.27 Testing: ebay.com
[task 2023-07-02T05:41:25.325Z]  0:02.27 Testing: force.com
[task 2023-07-02T05:41:25.326Z]  0:02.27 Testing: amazon.in
[task 2023-07-02T05:41:25.333Z]  0:02.28 Testing: adobe.com
[task 2023-07-02T05:41:25.335Z]  0:02.28 Testing: aliexpress.com
[task 2023-07-02T05:41:25.337Z]  0:02.29 Testing: linkedin.com
[task 2023-07-02T05:41:25.345Z]  0:02.29 Testing: tianya.cn
[task 2023-07-02T05:41:25.349Z]  0:02.30 Testing: yy.com
[task 2023-07-02T05:41:25.351Z]  0:02.30 Testing: huanqiu.com
[task 2023-07-02T05:41:25.354Z]  0:02.30 Testing: amazon.co.jp
[task 2023-07-02T05:41:25.359Z]  0:02.31 Testing: okezone.com
[task 2023-07-02T05:43:54.369Z]  2:31.32 google.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcX9_1RS
[task 2023-07-02T05:43:59.161Z]  2:36.11 jd.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcXV_1RN
[task 2023-07-02T05:44:11.424Z]  2:48.37 google.com.hk test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcTB_1RZ
[task 2023-07-02T05:44:20.861Z]  2:57.81 baidu.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcR3_1RT
[task 2023-07-02T05:44:21.724Z]  2:58.67 naver.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcWJ_1RM
[task 2023-07-02T05:44:26.723Z]  3:03.67 microsoft.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcTN_1RR
[task 2023-07-02T05:44:32.837Z]  3:09.78 tianya.cn test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDc23_1S5
[task 2023-07-02T05:44:32.837Z]  3:09.79 W Something went wrong with firstview/repeat view runs for: tianya.cn
[task 2023-07-02T05:44:32.837Z]  3:09.79 E Fail https://tianya.cn
[task 2023-07-02T05:44:44.196Z]  3:21.14 yahoo.co.jp test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDc6Q_1S0
[task 2023-07-02T05:44:44.813Z]  3:21.76 zoom.us test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDc57_1RY
[task 2023-07-02T05:44:45.187Z]  3:22.14 huanqiu.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcDG_1S7
[task 2023-07-02T05:44:50.165Z]  3:27.11 ebay.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcV9_1S4
[task 2023-07-02T05:44:58.597Z]  3:35.55 twitter.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcER_1RQ
[task 2023-07-02T05:45:01.690Z]  3:38.64 amazon.co.jp test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcHT_1S6
[task 2023-07-02T05:45:06.720Z]  3:43.67 amazon.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDc0Q_1RP
[task 2023-07-02T05:45:11.777Z]  3:48.73 youtube.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcDC_1RW
[task 2023-07-02T05:45:24.100Z]  4:01.05 amazon.in test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcHS_1S1
[task 2023-07-02T05:45:28.389Z]  4:05.34 sohu.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcRK_1RV
[task 2023-07-02T05:48:20.064Z]  6:57.01 linkedin.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDc8Z_1S3
[task 2023-07-02T05:48:58.281Z]  7:35.23 sina.com.cn test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcH9_1RX
[task 2023-07-02T05:48:58.281Z]  7:35.23 W Something went wrong with firstview/repeat view runs for: sina.com.cn
[task 2023-07-02T05:49:33.261Z]  8:10.21 yy.com test can be found here: https://www.webpagetest.org/results.php?test=230702_BiDcRE_1S2
[task 2023-07-02T05:49:33.261Z]  8:10.21 W Something went wrong with firstview/repeat view runs for: yy.com
[taskcluster 2023-07-02T05:58:10.616Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688278690.597
[taskcluster 2023-07-02T06:15:10.706Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688279710.685
[taskcluster 2023-07-02T06:32:10.802Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688280730.781
[taskcluster 2023-07-02T06:49:10.890Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688281750.87
[taskcluster 2023-07-02T07:06:10.989Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688282770.958
[taskcluster 2023-07-02T07:23:11.079Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688283791.046
[taskcluster 2023-07-02T07:40:11.154Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688284811.129
[taskcluster 2023-07-02T07:57:11.253Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688285831.213
[taskcluster 2023-07-02T08:14:11.469Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688286851.429
[taskcluster 2023-07-02T08:31:11.681Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/FNjC7XW6Tc6SjBmCt5lrww/0/on/mdc1/t-linux64-ms-190/until/1688287871.652
[taskcluster:error] Aborting task...
[taskcluster:warn 2023-07-02T08:41:11.245Z] no such process
[taskcluster 2023-07-02T08:41:11.245Z] === Task Finished ===
[taskcluster 2023-07-02T08:41:11.245Z] Task Duration: 3h0m0.000675185s
[taskcluster 2023-07-02T08:41:11.315Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2023-09-30T04:05:23.823Z
[taskcluster:error] Task aborted - max run time exceeded

Hi, can you please take a look at this? Can this be caused by https://hg.mozilla.org/mozilla-central/rev/bde95b6dffb074fe786cb6172048edc746f3dd83 ? If not maybe you know someone who can help us with this.
Thanks!

Flags: needinfo?(hskupin)

Wdspec tests have nothing to do with perftests. The underlying reason is clearly something different.

Flags: needinfo?(hskupin) → needinfo?(gmierz2)

:aglavic, can you look into this?

Flags: needinfo?(gmierz2) → needinfo?(aglavic)

Yes, I will investigate!

This is a weird bug, there have been no failures in the past week the timeout is very weird(this is the first time a timeout has even occurred)
I will investigate if this error comes up again I will close the bug since it's no longer occurring and webpagetest jobs are passing

Flags: needinfo?(aglavic)
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.