Closed Bug 1944308 Opened 1 year ago Closed 1 year ago

Change mochitest layer to use the actual test name instead of the script name

Categories

(Testing :: mozperftest, defect, P2)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: sparky, Assigned: myeongjun.ko)

References

(Blocks 1 open bug)

Details

(Whiteboard: [fxp][operational])

Attachments

(1 external file)

Currently, the mochitest test layer uses the script name as the test name. It should be using the test name that is found in the script. For example, in this test: https://searchfox.org/mozilla-central/rev/a965e3c683ecc035dee1de72bd33a8d91b1203ed/toolkit/components/ml/tests/browser/browser_ml_suggest_feature_perf.js#7

We're using browser_ml_suggest_feature_perf.js, but we should be using the test name from the perfMetadata which is ML Suggest Feature.

We will need to run two variants of this test in parallel for two weeks (one with the old test name, and one with the correct test name). After those two weeks, we can disable the variant with the old test name.

Here's an example of a mochitest test running in CI on windows 11 (they run on linux, and mac too): https://searchfox.org/mozilla-central/source/taskcluster/kinds/perftest/windows11.yml#272-295

We will need to duplicate these tasks, change the task name, and symbol, then also add an option like --name-change to trigger a change in the test name.

Assignee: nobody → myeongjun.ko
Status: NEW → ASSIGNED
Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/22a7b7cb7643 Change mochitest layer to use the actual test name instead of the script name r=sparky,perftest-reviewers DONTBUILD
Keywords: leave-open

The leave-open keyword is there and there is no activity for 6 months.
:fbilt, maybe it's time to close this bug?
For more information, please visit BugBot documentation.

Flags: needinfo?(fbilt)
Status: ASSIGNED → RESOLVED
Closed: 1 year ago
Flags: needinfo?(fbilt)
Resolution: --- → FIXED
Whiteboard: [fxp] → [fxp][operational]
Severity: S3 → S2
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: