1192369 - [15Q3] Replace custom test runner script for firefox-ui-tests with mozharness when executing tests via Jenkins

Status: RESOLVED FIXED

(Testing :: Firefox UI Tests, defect)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Currently we have custom execution scripts for every testrun in the Firefox UI tests. This is mostly just a hack to get things working. Given that we want more stable tests and a proper reporting to treeherder, we have to replace those scripts with the mozharness script. Also having a standardized execution of tests will make it easier for us to change the execution platform to taskcluster later this year.

https://github.com/mozilla/mozmill-ci/tree/master/jenkins-master/jobs/scripts/workspace

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

All necessary information to get this goal done will be collected in the following etherpad:
https://ateam.etherpad.mozilla.org/fx-automation-mozharness

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The mozharness scripts are close to be finished, except the upload to S3 and Treeherder reporting feature. Those steps cannot be part of mozharness (see bug 1207581 and bug 1207580). That means we will have to implement appropriate code in mozmill ci. Given that I cannot add a Github issue as dependency I'm just listing it here: https://github.com/mozilla/mozmill-ci/issues/661. I will work on this next.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2]]

All mozharness work has been done. There might be smaller improvements we can do but those can be follow-ups. So it's ready to be used now.