1574254 - reduce time limit for xpcshell tests

Status: RESOLVED FIXED

(Testing :: XPCShell Harness, task)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

XPCshell average run times: https://sql.telemetry.mozilla.org/queries/64202/

platform                    option_nameavg_run_time
android-em-4-3-armv7-api16  debug         2721.4643
android-em-4-3-armv7-api16  opt           1693.4756
android-em-4-3-armv7-api16  pgo           1619.7107
android-em-4-3-armv7-api16-popt           1636.6389
linux32                     debug           772.144
linux32                     opt            552.8113
linux32-shippable           opt            573.7104
linux64                     asan           980.7324
linux64                     debug          893.4846
linux64                     opt            741.2458
linux64                     pgo            519.8265
linux64-ccov                debug         1524.6384
linux64-pgo-qr              opt            486.7168
linux64-qr                  debug         1101.7939
linux64-qr                  opt            752.6623
linux64-shippable           opt            800.8776
linux64-shippable-qr        opt            820.0319
macosx1010-64               debug         1673.2731
macosx1010-64-shippable     opt            647.5925
macosx1014-64               debug         1614.3524
macosx1014-64-shippable     opt           1347.3159
osx-10-10                   debug         2692.6305
osx-10-10                   opt           1297.6238
osx-10-10-shippable         opt           2106.5823
windows10-64                asan               1479
windows10-64                debug         1689.3483
windows10-64                opt           1241.2059
windows10-64                pgo           1426.6272
windows10-64-ccov           debug         1785.3859
windows10-64-shippable      opt            1131.545
windows10-aarch64           opt           2214.3712
windows7-32                 debug         1746.8272
windows7-32                 opt           1432.2346
windows7-32                 pgo           1441.5308
windows7-32-shippable       opt            1406.929

Default limits are 2h for Android 4.3 debug and 1.5h for anything else.

Should Android 4.3 debug, OS X opt and debug and Windows 10 aarch be lowered to 1h and everything else to 45 minutes?

Had stumbled upon https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception%2Cusercancel%2Cretry%2Csuperseded&selectedJob=261808588 which took 74 instead of ~25 minutes (some gaps close to 10 minutes in the middle of the task run).

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

I agree this is a good find. Thanks for mentioning this. :aryx, do you want to create the patch, or should :egao pick this up next week?

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1574254 - adjust XPCshell max run times. r=jmaher

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d7fe58f35d9c
adjust XPCshell max run times. r=jmaher

Comment 4

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/d7fe58f35d9c

Comment 5

[Geoff Brown [:gbrown]]

There are some android xpcshell failures now due to exceeding the max-run-time:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=xpcshell&revision=115a4bcdb596c246f51658458951eda23bf4e696

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1574254 - adjust XPCshell max run times. r=gbrown

Some chunks run longer than an hour.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/131b535db16f
adjust XPCshell max run times. r=gbrown

Comment 8

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/131b535db16f