1398172 - Talos tp6 is running on win stylo-disabled on autoland/inbound but no other talos tests are

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Robert Wood [:rwood]]

The full set of Talos tests on stylo-disabled (Tsd-e10s) are running on mozilla-central and on try (linux/osx/win). However on autoland/inbound, on windows, 'tp6' is running on stylo-disabled (and no other talos tests).

Comment 1

[Robert Wood [:rwood]]

:bholley, :jryans, can we remove stylo-disabled tp6 from autoland/inbound, and only have it run on mozilla-central/try, so it is consistent with all the other talos tests?

Comment 2

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

(In reply to Robert Wood [:rwood] from comment #1)
> :bholley, :jryans, can we remove stylo-disabled tp6 from autoland/inbound,
> and only have it run on mozilla-central/try, so it is consistent with all
> the other talos tests?

Removing it from inbound sounds fine, I believe it was only there because that's how other tp6 runs were configured.  Stylo work doesn't really involve inbound much, so it's not very useful to have.

Autoland is slightly more useful to have for Stylo work, but since we're talking about stylo-disabled runs, we wouldn't expect those to change significantly, so central and try only should be fine here.

If we can, keeping the regular, Stylo enabled Windows tp6 runs enabled for at least autoland would be nice (but it doesn't sound like you are proposing to change those anyway).

Comment 3

[Bobby Holley (:bholley)]

If possible, it would make my life marginally easier to keep running them on autoland for the next two weeks up until the merge.

I spend a lot of time looking at graphs like:

https://treeherder.mozilla.org/perf.html#/graphs?timerange=604800&series=autoland,1535525,1,1&series=autoland,1534934,1,1&series=autoland,1535521,1,1&series=autoland,1549461,1,1&series=autoland,1549460,1,1

The extra density of data points from running on autoland is really helpful when trying to figure out if there's a real stylo-specific regression or not.

It's not make-or-break, but if we can delay this cleanup by two weeks I'd prefer that. Getting rid of them on inbound is fine.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

we can definitely wait the 2 weeks

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: remove tp6-stylo-disabled from running on autoland/inbound

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/2a0834c4397e
only run tp6 on stylo-disabled for beta/central/try branches. r=rwood

Comment 7

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/2a0834c4397e