1564844 - Move raptor-tp6m-n-fennec68 tests into the correct platform

Status: RESOLVED FIXED

(Testing :: Raptor, task, P2)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The raptor-tp6m-n-fennec64 tests are currently in the android-hw-arm7-raptor-nightly platform, however these should be in android-hw-aarch64-raptor along with the cold load tests. I believe this is causing the tests to be split across platforms in Treeherder.

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

It looks like this might still be an issue, although there have been several changes to this configuration. The lines of concern are at https://searchfox.org/mozilla-central/rev/cfd1cc461f1efe0d66c2fdc17c024a203d5a2fd8/taskcluster/ci/test/test-sets.yml#987-997

android-hw-arm7-raptor-nightly:
    - raptor-tp6m-1-fennec68
    - raptor-tp6m-2-fennec68
    - raptor-tp6m-3-fennec68
    - raptor-tp6m-4-fennec68
    - raptor-tp6m-5-fennec68
    - raptor-tp6m-6-fennec68
    - raptor-tp6m-7-fennec68
    - raptor-tp6m-8-fennec68
    - raptor-tp6m-9-fennec68
    - raptor-tp6m-10-fennec68

I'm uncertain what the significance of having these appear under this platform in addition to the others. Let's determine what these are doing, and remove them if they are causing duplication, or are unused.

Comment 2

[Marian Raiciof [:marauder]]

Hey Dave,

Here are my findings:

[1] In https://searchfox.org/mozilla-central/source/taskcluster/ci/test/test-platforms.yml the set android-hw-arm7-raptor-nightly is no longer available. (Maybe it was removed when GeckoView 71 for Fenix was launched and no longer needed.)

• in other words there is no platform related to this set

[2] The tests raptor-tp6m-n-fennec68 are grouped in taskcluster/ci/test/test-sets.yml under android-hw-arm7-raptor set,
and because of that they are currently running on these platforms:

• android-hw-g5-7-0-arm7-api-16/opt
• android-hw-g5-7-0-arm7-api-16/pgo
• android-hw-p2-8-0-arm7-api-16/opt
  https://searchfox.org/mozilla-central/source/taskcluster/ci/test/test-platforms.yml#432,442,459

As i see it, we have two options:

• delete them together with the set
• or move them under android-hw-aarch64-raptor, as stated in description #c0 and we will cover these 2 platforms:
  -- android-hw-p2-8-0-android-aarch64/opt
  -- android-hw-p2-8-0-android-aarch64/pgo

Comment 3

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Does that mean we're not currently able to schedule warm pageload tests for Fennec ESR68? I would say let's move them to android-hw-aarch64-raptor and delete android-hw-arm7-raptor-nightly.

Comment 4

[Marian Raiciof [:marauder]]

Attachment: Bug 1564844 - Move raptor-tp6m-n-fennec68 tests into the correct platform

Comment 5

[Marian Raiciof [:marauder]]

We had warm pageload tests before, but only for G5 (opt and pgo) and P2 (for this one only opt builds, not pgo. Because of this : https://searchfox.org/mozilla-central/source/taskcluster/ci/test/test-platforms.yml#450).

This is the last run of the cron job for fennec68:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=fennec68&tochange=aff3f91d0931e798c9be59c1c2f84fab50ec4979&fromchange=aff3f91d0931e798c9be59c1c2f84fab50ec4979&group_state=expanded

Now we have aarch64 covered as well, both opt and pgo.
Push to try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=b033b7c5607b922bf3d5d15b827561c907169897

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/49d9bc95033d
Move raptor-tp6m-n-fennec68 tests into the correct platform r=perftest-reviewers,AlexandruIonescu

Comment 7

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/49d9bc95033d