[15Q3] Replace custom test runner script for firefox-ui-tests with mozharness when executing tests via Jenkins

RESOLVED FIXED

Status

Testing
Firefox UI Tests
RESOLVED FIXED
3 years ago
2 years ago

People

(Reporter: whimboo, Assigned: whimboo)

Tracking

({meta})

Firefox Tracking Flags

(Not tracked)

Details

(URL)

(Assignee)

Description

3 years ago
Currently we have custom execution scripts for every testrun in the Firefox UI tests. This is mostly just a hack to get things working. Given that we want more stable tests and a proper reporting to treeherder, we have to replace those scripts with the mozharness script. Also having a standardized execution of tests will make it easier for us to change the execution platform to taskcluster later this year.

https://github.com/mozilla/mozmill-ci/tree/master/jenkins-master/jobs/scripts/workspace
(Assignee)

Updated

3 years ago
Keywords: meta
(Assignee)

Updated

3 years ago
Depends on: 1193024
(Assignee)

Comment 1

3 years ago
All necessary information to get this goal done will be collected in the following etherpad:
https://ateam.etherpad.mozilla.org/fx-automation-mozharness
(Assignee)

Updated

3 years ago
Depends on: 1193508

Updated

3 years ago
Blocks: 1159527
(Assignee)

Updated

3 years ago
Depends on: 1197358
(Assignee)

Updated

3 years ago
Blocks: 1197234
(Assignee)

Updated

2 years ago
Depends on: 1209209
(Assignee)

Comment 2

2 years ago
The mozharness scripts are close to be finished, except the upload to S3 and Treeherder reporting feature. Those steps cannot be part of mozharness (see bug 1207581 and bug 1207580). That means we will have to implement appropriate code in mozmill ci. Given that I cannot add a Github issue as dependency I'm just listing it here: https://github.com/mozilla/mozmill-ci/issues/661. I will work on this next.
(Assignee)

Comment 3

2 years ago
All mozharness work has been done. There might be smaller improvements we can do but those can be follow-ups. So it's ready to be used now.
Status: ASSIGNED → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → FIXED
(Assignee)

Updated

2 years ago
Depends on: 1210753
(Assignee)

Updated

2 years ago
Blocks: 1214372
Product: Mozilla QA → Testing
You need to log in before you can comment on or make changes to this bug.