1633458 - add perftest support in taskcluster tests kind definition

Status: NEW

(Testing :: mozperftest, enhancement, P2)

Description

[Tarek Ziadé (:tarek)]

run the applink test on bitbar for fenix + g5

Comment 1

[Andrew Creskey [:acreskey]]

This is the usage,

Fenix:

./mach perftest testing/performance/perftest_applink.js --android-install-apk ~/fenix.v2.fennec-nightly.2020.04.22-arm32.apk --hooks testing/performance/hooks_applink.py --android-app-name org.mozilla.fennec_aurora --perfherder-metrics processLaunchToNavStart

Fennec:

./mach perftest testing/performance/perftest_applink.js --android-install-apk ~/fennec68.apk --hooks testing/performance/hooks_applink.py --android-app-name org.mozilla.firefox --perfherder-metrics processLaunchToNavStart

Comment 2

[Tarek Ziadé (:tarek)]

Attachment: Bug 1633458 - add perftest support in taskcluster tests kind definition

work in progress, you can review if you want but it's not fully ready

This patch allows us to run perftest in the CI
in all kind of runners

Comment 3

[Andrew Creskey [:acreskey]]

Once bug 1634516 lands, the usage will be slightly different, passing in the android-activity.
e.g.

./mach perftest testing/performance/perftest_applink.js --android --hooks testing/performance/hooks_applink.py --perfherder-metrics processLaunchToNavStart --android-app-name org.mozilla.fennec_aurora --android-activity org.mozilla.fenix.IntentReceiverActivity --android-install-apk ~/fenix.v2.fennec-nightly.2020.04.30_x86.apk

Comment 4

[Tarek Ziadé (:tarek)]

successful try run on bitbar here on a g5:

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=5a8890dea836793f9e32d186ce2eeecece6d7f2f

I need to split out the mozperftest changes in a specific patch and we should talk about the UI we want here for running in TC

Comment 5

[Tarek Ziadé (:tarek)]

one thing that could be interesting to consider:

can we modify/add/tweak the tests from a github repo without having to push changes in m-c ?
if we delegate some of this performance tests runs into a satellite repo, it gives folks like Andrew more agility
on a daily basis, to run experiments etc..

see Bug 1635136

Comment 6

[Tarek Ziadé (:tarek)]

Now that we have it working for g5, Greg is going to cleanly integrate it into TC.