1554308 - Raptor tests on Beta are running on both opt & pgo builds

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Ryan VanderMeulen [:RyanVM]]

I noticed today that Raptor tests are running on both opt and PGO Android builds. Given that we have limited capacity for these tests, we probably want to get rid of the opt runs so just PGO remains.

Comment 1

[Robert Wood [:rwood]]

Raptor android opt runs currently running on beta (and also running on pgo), that need to be disabled:

tp6m-c-1, 2, 3 4, 5, and 6
speedometer
tp6m-5, 6, and 8

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

This, alongside my change in bug #1553310 may explain the backlog of tasks on P2? Or are they in separate pools of devices?

Comment 3

[Robert Wood [:rwood]]

Attachment: Bug 1554308 - Raptor tests on Beta are running on both opt & pgo builds

Comment 4

[Robert Wood [:rwood]]

./mach try fuzzy --full

Exception: Multiple matching values for test-platform u'android-hw-p2-8-0-arm7-api-16/opt' found while determining item run-on-projects in raptor-tp6m-2-geckoview-cold

hmm I don't see why

Comment 5

[Robert Wood [:rwood]]

Ah maybe I need to update the first entry (android-hw-p2-8-0-arm7.*) to be .pgo.

    by-test-platform:
        android-hw-p2-8-0-arm7.*: ['try', 'mozilla-central']
        android-hw-.*-api-16/opt: ['try', 'trunk']
        android-hw-.*-aarch64/opt: ['try', 'trunk']

Comment 6

[Robert Wood [:rwood]]

That fixed it. Updated phab, try push (although can't test on beta, just a 'sanity' check):

https://treeherder.mozilla.org/#/jobs?repo=try&revision=5641a2d0d595e26e7d487428429722a263127ca3

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/440bee55379e
Raptor tests on Beta are running on both opt & pgo builds r=jmaher

Comment 8

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/440bee55379e

Comment 9

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/8877cfc4f108