1605457 - awsy jobs on autoland are running both on opt and shippable builds

Status: RESOLVED FIXED

(Testing :: AWSY, task, P1)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=awsy&revision=54a84425dcf0fb18b1908aabfa51a7ccbb020c8c

we have opt vs shippable for:
linux64
linux64-qr
win7
win10
win10-qr

removing the duplication would save 15 jobs from running every 10th push.

We should also revisit if there is a need for linux64 stylo-seq (sy).

:rwood, can you comment as to whether there is a need for the AWSY jobs on opt as well as linux64-ss(sy) ?

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:rwood ^ ?

Comment 2

[Robert Wood [:rwood]]

:rwood, can you comment as to whether there is a need for the AWSY jobs on opt as well as linux64-ss(sy) ?

Hey, I'm not familiar with the AWSY jobs, :sparky, :stephend, would you guys know whom on our team looks after those and/or could help answer Joel's question?

Comment 3

[Eric Rahm [:erahm]]

I think it's a more general question: does anything need the stylo-seq config at this point? It was useful for comparisons during development of stylo but at this point I think we have it flipped on everywhere.

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to Robert Wood [:rwood] from comment #2)
<snip>

Hey, I'm not familiar with the AWSY jobs, :sparky, :stephend, would you guys know whom on our team looks after those and/or could help answer Joel's question?

I've helped coordinate a bit with Fission enabling for our various suites (for which Marian has done nearly all the work), and promoting it to tier 1 in bug 1567138, but am not familiar with the needs/differences, considerations, and potential redundancies here, sorry.

I'm +1 for freeing up capacity, especially since we're going to want to run more Fission-enabled AWSY-tp6 tests on autoland, in the future (since we now have bug 1599621 and friends).

Comment 5

[Greg Mierzwinski [:sparky]]

+1 for only testing on shippable builds and disabling opt builds for AWSY.

Looking at the AWSY SY-TP6 tests I see that linux64-opt was enabled in september and shippable was used for much longer before that (so it has more history). Plus, looking at the data they seem to overlap with each other quite well: https://treeherder.mozilla.org/perf.html#/graphs?highlightAlerts=1&series=autoland,1958962,1,4&series=autoland,1978970,1,4&timerange=31536000&zoom=1566778200660,1578539664257,459197590.0477432,629024102.4182734

I also see that the opt build might have been inadvertently turned on because of this patch: https://hg.mozilla.org/integration/autoland/rev/1d1c363874d5a70bbbf543cb5ee7407df9ce926e

I say that because the opt build tests didn't start until after that patch - see here for the oldest test on opt (in the last year): https://treeherder.mozilla.org/perf.html#/graphs?highlightAlerts=1&selected=2118063,904350571&series=autoland,2118063,1,4&timerange=31536000&zoom=1567043697228,1567063296623,367940376.8694269,386322513.39322084

I'm not sure about the stylo-seq builds though. :erahm could add some people into the convo here so we can determine if anyone/anything is still using it?

Comment 6

[Eric Rahm [:erahm]]

(In reply to Greg Mierzwinski [:sparky] from comment #5)

I'm not sure about the stylo-seq builds though. :erahm could add some people into the convo here so we can determine if anyone/anything is still using it?

We don't think so, it's being removed in bug 1607344.

Comment 7

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The stylo jobs were disabled in bug 1607344. I don't see any objections in this bug to disabling the opt jobs for AWSY and just keeping the shippable jobs. Moving this into our queue.

Comment 8

[Marian Raiciof [:marauder]]

Attachment: Bug 1605457 - Awsy jobs on autoland are running both on opt and shippable builds

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4c1207eaf43d
Awsy jobs on autoland are running both on opt and shippable builds r=perftest-reviewers,sparky

Comment 10

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/4c1207eaf43d