1854674 - Figure out why a set of tests have no subtest value associated with them

Status: NEW

(Testing :: Raptor, defect, P3)

Description

[Andrej (:aglavic)]

Related to 1848881

It was identified that on mobile a few benchmarks have no subtest section and require us to make specific accommodations for them in fuzzy parsing, this bug is to understand why and fix it by simplifying the code logic

Comment 1

[Andrej (:aglavic)]

All the tests that do not have a subtest associated with them, and are not being filtered by: https://searchfox.org/mozilla-central/source/taskcluster/gecko_taskgraph/transforms/test/raptor.py#134 are all mobile tests defined in taskcluster/ci/test/browsertime-mobile.yml
It look like we'll have to reformat the file(browsertime-mobile.yml) to have the benchmarks appear in a similar format to the desktop ones to avoid this issue

• browsertime-benchmark-unity-webgl-mobile-geckoview
• browsertime-benchmark-unity-webgl-mobile-fenix
• browsertime-benchmark-unity-webgl-mobile-chrome-m
• browsertime-benchmark-speedometer3-mobile-geckoview
• browsertime-benchmark-speedometer3-mobile-fenix
• browsertime-benchmark-speedometer3-mobile-chrome-m
• browsertime-benchmark-speedometer-mobile-geckoview
• browsertime-benchmark-speedometer-mobile-fenix
• browsertime-benchmark-speedometer-mobile-chrome-m
• browsertime-benchmark-unity-webgl-mobile-geckoview
• browsertime-benchmark-unity-webgl-mobile-fenix
• browsertime-benchmark-unity-webgl-mobile-chrome-m
• browsertime-benchmark-speedometer3-mobile-geckoview
• browsertime-benchmark-speedometer3-mobile-fenix
• browsertime-benchmark-speedometer3-mobile-chrome-m
• browsertime-benchmark-speedometer-mobile-geckoview
• browsertime-benchmark-speedometer-mobile-fenix
• browsertime-benchmark-speedometer-mobile-chrome-m

Comment 2

[Andrej (:aglavic)]

Now that motionmark for android has been merged, this will come up and be brought up and completed

Comment 3

[Andrej (:aglavic)]

Attachment: Bug 1854674 - Reformat mobile browsertime yml file to be like desktop. r?#perftest

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

There is an r+ patch which didn't land and no activity in this bug for 2 weeks.
:aglavic, could you have a look please?
If you still have some work to do, you can add an action "Plan Changes" in Phabricator.
For more information, please visit BugBot documentation.

Comment 5

[Andrej (:aglavic)]

Yes sorry I had a change I made that I know will cause merge conflicts but then I got distracted from other work that was more important, I've just added a changes planned tag now