1546704 - Fix subtest names for cold page-load Fenix suites

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Robert Wood [:rwood]]

raptor-tp6m-cold-1.ini is correct, i.e:

[raptor-tp6m-cold-amazon-geckoview]

However the rest of the tp6m-cold-* suites are missing "cold" from each subtest name. Currently Raptor is adding '-cold' to the test name since it's missing; however we need to add 'cold' to the subtest names to be consistent and also for when running a single cold page-load test locally.

Comment 1

[Robert Wood [:rwood]]

Note: I'm going to have the subtests named like this:

[raptor-tp6m-amazon-geckoview-cold]

i.e. with '-cold' on the end. This will make it consistent with other names i.e. when running --power-test or --memory test, '-power' or '-memory' is automatically appended to the test name. Also the cold page-load already running has been adding '-cold' to the end of the subtest name automatically for those that were missing 'cold' in the name.

Comment 2

[Robert Wood [:rwood]]

Attachment: Bug 1546704 - Fix subtest names for cold page-load Fenix suites; r?davehunt,bebe

Comment 3

[Robert Wood [:rwood]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=fbd129e9638865367b13d71664f0d18e2506b3b4

Comment 4

[Robert Wood [:rwood]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=f674992f4cec1dc3c28ec6475350bd151034c3ed

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7592e8e3d32e
Fix subtest names for cold page-load Fenix suites; r=Bebe

Comment 6

[Oana Pop-Rus]

https://hg.mozilla.org/mozilla-central/rev/7592e8e3d32e

Comment 7

[Dave Hunt [:davehunt] [he/him] ⌚BST]

It looks like this isn't being picked up by the Fenix jobs. Tests run two days after this landed still show the old test names: https://treeherder.mozilla.org/#/jobs?repo=fenix&revision=e6c34f7045f36c091848c0ecaffbb09d5c95d35e&selectedJob=243057991&group_state=expanded

Comment 8

[Dave Hunt [:davehunt] [he/him] ⌚BST]

:jlorenzo is there anything we need to do to have this change picked up by the Fenix jobs?

Comment 9

[Johan Lorenzo [:jlorenzo]]

That's right. You need to update Fenix to use a more recent Geckoview nightly. I just updated the wiki page to reflect that[1]. Sorry, that wasn't crystal clear. Please let me know if something is not obvious from these docs! 🙂

[1] https://wiki.mozilla.org/Performance_sheriffing/Raptor#Raptor_on_Mobile_projects_.28Fenix.2C_Reference-Browser.29