1526659 - Intermittent jsreftest [taskcluster:error] Task aborted - max run time exceeded

Status: RESOLVED FIXED

(Core :: JavaScript Engine, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=227382544&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/EYfECxFGRTes1NMMDzdgUQ/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/EYfECxFGRTes1NMMDzdgUQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

10:49:19 INFO - REFTEST TEST-START | file:///Z:/task_1549704618/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/try/cptn-catch.js
10:49:19 INFO - REFTEST TEST-LOAD | file:///Z:/task_1549704618/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/try/cptn-catch.js | 20540 / 21195 (96%)
10:49:19 INFO - ++DOMWINDOW == 124 (0EBF9400) [pid = 4632] [serial = 29671] [outer = 0820A410]
10:49:19 INFO - REFTEST TEST-PASS | file:///Z:/task_1549704618/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/try/cptn-catch.js | item 1
10:49:19 INFO - REFTEST TEST-END | file:///Z:/task_1549704618/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/try/cptn-catch.js
10:49:19 INFO - ++DOMWINDOW == 125 (0EBF3800) [pid = 4632] [serial = 29672] [outer = 0820A410]
[taskcluster:error] Aborting task...
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 4632 (child process of PID 4660) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 4192 (child process of PID 4660) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 4964 (child process of PID 4660) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 4660 (child process of PID 3016) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 3016 (child process of PID 4016) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 1144 (child process of PID 5444) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 4016 (child process of PID 5444) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 5444 (child process of PID 2340) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z] SUCCESS: The process with PID 2340 (child process of PID 5088) has been terminated.
[taskcluster 2019-02-09T10:49:20.227Z]
[taskcluster 2019-02-09T10:49:20.227Z] === Task Finished ===
[taskcluster 2019-02-09T10:49:20.227Z] Task Duration: 59m35.4795122s
[taskcluster 2019-02-09T10:49:20.567Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:21.227Z] Uploading artifact public/logs/log_critical.log from file logs\log_critical.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:21.563Z] Uploading artifact public/logs/log_error.log from file logs\log_error.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:21.903Z] Uploading artifact public/logs/log_fatal.log from file logs\log_fatal.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:22.235Z] Uploading artifact public/logs/log_info.log from file logs\log_info.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:23.684Z] Uploading artifact public/logs/log_raw.log from file logs\log_raw.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:24.547Z] Uploading artifact public/logs/log_warning.log from file logs\log_warning.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:24.909Z] Uploading artifact public/test_info/jsreftest_errorsummary.log from file build\blobber_upload_dir\jsreftest_errorsummary.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:25.290Z] Uploading artifact public/test_info/jsreftest_raw.log from file build\blobber_upload_dir\jsreftest_raw.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:27.414Z] Uploading artifact public/test_info/system-info.log from file build\blobber_upload_dir\system-info.log with content encoding "gzip", mime type "text/plain" and expiry 2020-02-09T08:40:52.103Z
[taskcluster 2019-02-09T10:49:28.028Z] Uploading redirect artifact public/logs/live.log to URL https://queue.taskcluster.net/v1/task/EYfECxFGRTes1NMMDzdgUQ/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2020-02-09T08:40:52.103Z
[taskcluster:error] Task aborted - max run time exceeded

Comment 1

[Intermittent Failures Robot]

1 failures in 2658 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 2832 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 3

[Intermittent Failures Robot]

5 failures in 2818 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1
• autoland: 4

Platform breakdown:

• linux32: 1
• osx-10-10: 2
• windows7-32: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 4

[Intermittent Failures Robot]

3 failures in 3910 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 2

Platform breakdown:

• osx-10-10: 1
• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 2843 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 6

[Intermittent Failures Robot]

2 failures in 3031 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 7

[Intermittent Failures Robot]

5 failures in 4131 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 4
• mozilla-central: 1

Platform breakdown:

• windows10-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 8

[Intermittent Failures Robot]

14 failures in 4705 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 3
• mozilla-inbound: 5

Platform breakdown:

• windows10-64: 10
• windows7-32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 9

[Intermittent Failures Robot]

14 failures in 4658 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 4
• autoland: 5
• mozilla-central: 4
• mozilla-beta: 1

Platform breakdown:

• windows10-64: 6
• windows7-32: 6
• windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 10

[Intermittent Failures Robot]

18 failures in 4730 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 4
• try: 1
• autoland: 13

Platform breakdown:

• windows7-32: 8
• windows10-64: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 11

[Intermittent Failures Robot]

17 failures in 4337 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• try: 2
• mozilla-central: 3
• mozilla-inbound: 3

Platform breakdown:

• windows10-64: 7
• windows7-32: 8
• android-hw-p2-8-0-arm7-api-16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 12

[Intermittent Failures Robot]

31 failures in 5197 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• mozilla-inbound: 6
• autoland: 15
• try: 1

Platform breakdown:

• windows7-32: 19
• windows10-64: 9
• android-hw-p2-8-0-arm7-api-16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 13

[Intermittent Failures Robot]

32 failures in 4753 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 7
• autoland: 12
• mozilla-inbound: 10
• try: 3

Platform breakdown:

• windows10-64: 14
• android-hw-p2-8-0-arm7-api-16: 2
• windows7-32: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 14

[Intermittent Failures Robot]

15 failures in 515 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 5
• try: 1
• mozilla-central: 4
• autoland: 5

Platform breakdown:

• windows7-32: 13
• windows10-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-21&endday=2019-06-21&tree=all

Comment 15

[Intermittent Failures Robot]

37 failures in 2581 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• mozilla-central: 7
• mozilla-inbound: 9
• try: 2

Platform breakdown:

• windows7-32: 32
• windows10-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 16

[Intermittent Failures Robot]

23 failures in 847 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 4
• try: 3
• mozilla-inbound: 4

Platform breakdown:

• windows10-64: 8
• windows7-32: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-25&endday=2019-06-25&tree=all

Comment 17

[Intermittent Failures Robot]

35 failures in 844 pushes (0.041 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 5
• autoland: 26
• mozilla-inbound: 1
• try: 3

Platform breakdown:

• windows10-64: 16
• windows7-32: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-26&endday=2019-06-26&tree=all

Comment 18

[Andreea Pavel [:apavel]]

Steven can you please assign someone to take a look at this?

There are 117 total failures in the last 7 days on windows7-32 debug and windows10-64 debug and asan.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=253834010&repo=autoland&lineNumber=166014

1:24:26 INFO - REFTEST TEST-START | file:///Z:/task_1561676828/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/with/S12.10_A3.8_T2.js
01:24:26 INFO - REFTEST TEST-LOAD | file:///Z:/task_1561676828/build/tests/jsreftest/tests/jsreftest.html?test=test262/language/statements/with/S12.10_A3.8_T2.js | 21168 / 21372 (99%)
[taskcluster:error] Aborting task...
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 1624 (child process of PID 3152) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 2532 (child process of PID 3152) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 516 (child process of PID 3152) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 1256 (child process of PID 3152) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 3152 (child process of PID 1148) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 1148 (child process of PID 3492) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 3532 (child process of PID 3228) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 3492 (child process of PID 3228) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 3228 (child process of PID 2648) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z] SUCCESS: The process with PID 2648 (child process of PID 3864) has been terminated.
[taskcluster 2019-06-28T01:24:26.854Z]
[taskcluster 2019-06-28T01:24:26.855Z] === Task Finished ===
[taskcluster 2019-06-28T01:24:26.855Z] Task Duration: 1h0m1.016502s
[taskcluster 2019-06-28T01:24:27.675Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2020-06-26T23:01:06.247Z
[taskcluster 2019-06-28T01:24:28.637Z] Uploading artifact public/test_info/jsreftest_errorsummary.log from file build\blobber_upload_dir\jsreftest_errorsummary.log with content encoding "gzip", mime type "text/plain" and expiry 2020-06-26T23:01:06.247Z
[taskcluster 2019-06-28T01:24:29.273Z] Uploading artifact public/test_info/jsreftest_raw.log from file build\blobber_upload_dir\jsreftest_raw.log with content encoding "gzip", mime type "text/plain" and expiry 2020-06-26T23:01:06.247Z
[taskcluster 2019-06-28T01:24:32.962Z] Uploading artifact public/test_info/system-info.log from file build\blobber_upload_dir\system-info.log with content encoding "gzip", mime type "text/plain" and expiry 2020-06-26T23:01:06.247Z
[taskcluster 2019-06-28T01:24:33.710Z] Uploading redirect artifact public/logs/live.log to URL https://queue.taskcluster.net/v1/task/DNonm3LWSN2Gla0_IPFDEA/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2020-06-26T23:01:06.247Z
[taskcluster:error] Task aborted - max run time exceeded

Comment 19

[Intermittent Failures Robot]

41 failures in 792 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 2
• mozilla-inbound: 13
• try: 3

Platform breakdown:

• windows10-64: 20
• windows7-32: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-27&endday=2019-06-27&tree=all

Comment 20

[Jan de Mooij [:jandem]]

jsreftests timing out on Win debug builds. The snippet in comment 18 shows it's at 99% so it's close to finishing. Not too surprising because each test262 import brings with it many new tests.

We probably need 3 chunks instead of 2.

Comment 21

[Jan de Mooij [:jandem]]

Attachment: Bug 1526659 - Use the default 3 chunks instead of 2 for Windows debug/ASan jsreftests to avoid time-outs. r?jmaher!

Tests are imported from test262 upstream so this test suite is expected to become slower over time.

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/51dd2e169f3f
Use the default 3 chunks instead of 2 for Windows debug/ASan jsreftests to avoid time-outs. r=jmaher

Comment 23

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/51dd2e169f3f

Comment 24

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/c406e385f95d

Comment 25

[Intermittent Failures Robot]

120 failures in 4409 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-inbound: 25
• try: 10
• mozilla-beta: 1
• mozilla-central: 16
• autoland: 66
• mozilla-esr68: 2

Platform breakdown:

• windows7-32: 74
• windows10-64: 46

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1526659&startday=2019-06-24&endday=2019-06-30&tree=all