1399742 - Run reftest-stylo jobs on inbound, too.

Status: RESOLVED FIXED

(Core :: CSS Parsing and Computation, enhancement, P3)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Bug 1399461 is a near-permafailing reftest-stylo job that started on inbound. Inbound is not included in the repos that reftest-stylo currently run on. 

I think that was decided because these jobs were originally tier-2 and could theoretically only break via a landing from servo, which only happens on autoland, so these jobs were only enabled on autoland, m-c and try.

These tests can clearly break from stuff landing on inbound, so we should probably have these jobs running on inbound also.


We should probably also make sure other stylo jobs aren't being restricted from running on inbound.

If capacity issues are going to be a problem, is there a way to run these jobs less frequently on inbound, but still have them scheduled to run occasionally to ease backfilling?

Comment 1

[Daniel Holbert [:dholbert]]

Per https://groups.google.com/forum/#!msg/mozilla.dev.platform/H_Sl_-hCF5w/W7X_loXGAAAJ , stylo became the default ("on mozilla-central" at least), as of September 5th. (via bug 1330412)

So I'd thought that *all* test runs are now "stylo" flavored, and we now have accessory "stylo-disabled" test platforms as well.  Is that not the case on inbound?

Comment 2

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

reftest-stylo is strange beast that (despite its name) actually runs Stylo vs. Gecko mode, as opposed to the typical test vs. reference in the same engine.

So, it runs both Gecko and Stylo style systems for comparison purposes.

This special run only happens for autoland, m-c, and try at the moment:

http://searchfox.org/mozilla-central/rev/d08b24e613cac8c9c5a4131452459241010701e0/taskcluster/ci/test/tests.yml#1209

Comment 3

[Daniel Holbert [:dholbert]]

Aha, thanks for clarifying!

Comment 4

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

Attachment: Bug 1399742 - Use default branch list for reftest-stylo.

Review commit: https://reviewboard.mozilla.org/r/181958/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/181958/

Comment 5

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

Comment on attachment 8910527 [details]
Bug 1399742 - Use default branch list for reftest-stylo.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/181958/diff/1-2/

Comment 6

[Joel Maher ( :jmaher ) (UTC -8) (PTO'ish until July 5)]

Comment on attachment 8910527 [details]
Bug 1399742 - Use default branch list for reftest-stylo.

https://reviewboard.mozilla.org/r/181958/#review187340

glad we are making this 100% complete- lets ship Stylo!!!

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d1d44405008e
Use default branch list for reftest-stylo. r=jmaher

Comment 8

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/d1d44405008e