Add dedicated test config for fennec v64

RESOLVED FIXED in Firefox 69

Status

enhancement
RESOLVED FIXED
Last month
Last month

People

(Reporter: alexandrui, Assigned: alexandrui, Mentored)

Tracking

Version 3
mozilla69
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox69 fixed)

Details

Attachments

(1 attachment)

Currently fennec and fennec v64 are sharing the configuration in raptor-tp6m warm and cold, but this might cause confusion at some point, so a split is better.
https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests

rwood, I have to split fennec v64 tests from fennec ones (at davehunt's request). Giving that mozharness part of a test in raptor.yml looks like this:
mozharness:
extra-options:
- --test=raptor-tp6m-1-fennec64
- --app=fennec
- --binary=org.mozilla.firefox

currently there is just the app name as criteria to select tests to run from an ini file. Giving that fennec v64 and fennec run on the same app but different versions, we have 2 options I thought about:

  1. add separate ini files (raptor-tp6m-[1,10]-fennec64.ini) containing just the tests for fennec v64 (this seems to be the healthiest and easiest way)
  2. add support for fennec v64 (distinct from fennec) until the point that allows us to call the apps differently but use the same binary.

I tried to just add 'fennec64' string in lists here and there in central/testing/ to see whether I can fool the code to let me use 2 distinct app names using the same binary but I got some build fails. As I type an idea poped up, so I'll get back with a try build.

Flags: needinfo?(rwood)

(In reply to Alexandru Ionescu from comment #2)

  1. add separate ini files (raptor-tp6m-[1,10]-fennec64.ini) containing just the tests for fennec v64 (this seems to be the healthiest and easiest way)

Yes I agree - please go ahead with option 1 above (INIs) thanks!

Flags: needinfo?(rwood)
Pushed by dhunt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/3383a0903c29
Add dedicated test config for fennec v64 r=davehunt,perftest-reviewers
Status: NEW → RESOLVED
Closed: Last month
Resolution: --- → FIXED
Target Milestone: --- → mozilla69
You need to log in before you can comment on or make changes to this bug.