Open Bug 1944308 Opened 10 days ago Updated 10 days ago

Change mochitest layer to use the actual test name instead of the script name

Categories

(Testing :: mozperftest, defect, P2)

defect

Tracking

(Not tracked)

People

(Reporter: sparky, Unassigned)

References

(Blocks 1 open bug)

Details

(Whiteboard: [fxp])

Currently, the mochitest test layer uses the script name as the test name. It should be using the test name that is found in the script. For example, in this test: https://searchfox.org/mozilla-central/rev/a965e3c683ecc035dee1de72bd33a8d91b1203ed/toolkit/components/ml/tests/browser/browser_ml_suggest_feature_perf.js#7

We're using browser_ml_suggest_feature_perf.js, but we should be using the test name from the perfMetadata which is ML Suggest Feature.

We will need to run two variants of this test in parallel for two weeks (one with the old test name, and one with the correct test name). After those two weeks, we can disable the variant with the old test name.

Here's an example of a mochitest test running in CI on windows 11 (they run on linux, and mac too): https://searchfox.org/mozilla-central/source/taskcluster/kinds/perftest/windows11.yml#272-295

We will need to duplicate these tasks, change the task name, and symbol, then also add an option like --name-change to trigger a change in the test name.

You need to log in before you can comment on or make changes to this bug.