997954 - Switch b2g-inbound to running Mac tests only on 10.6 instead of only on 10.8

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Phil Ringnalda (:philor)]

We decided to make 10.8 the only Mac test platform for b2g-inbound during one of those desperate flurries before a b2g workweek when they wound up pushing less than normal, rather than more than normal, choosing 10.8 for the single reason that it finishes tests faster than 10.6.

Now we've got a perpetual 10-20 hour backlog of 10.8 tests, so that when someone actually does need 10.8 results for a patch affecting 10.8 itself, they'll typically have to wait a full day for results on Try, while b2g-inbound merrily runs 10.8 tests on merges from mozilla-central.

It was RyanVM who made the 10.8 decision, so my contention is that his "yeah, 10.6 is fine" (which we already have) is all the stakeholder agreement you need to switch to 10.6.

Comment 1

[Ryan VanderMeulen [:RyanVM]]

yeah, 10.6 is fine

Comment 2

[Armen [:armenzg]]

A whole day sounds pretty optimistic. I actually thought they needed to wait for a long enough tree closure or a weekend.

Comment 3

[Phil Ringnalda (:philor)]

Nope, even with open trees, some slaves make it through to try and twigs, like right now https://tbpl.mozilla.org/?tree=Try&rev=fddf1bd900e3 (the current back end of the backlog) has two suites running despite it being an open-tree middle of the day.

Comment 4

[Phil Ringnalda (:philor)]

Attachment: [configs] snowleopard

Perhaps, it's just that simple.

Comment 5

[Chris AtLee [:catlee]]

Comment on attachment 8409272 [details] [diff] [review]
[configs] snowleopard

Review of attachment 8409272 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm

Builders added:
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test cppunit
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test crashtest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test jetpack
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test jittest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test jsreftest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test marionette
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-1
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-2
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-3
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-4
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-5
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-browser-chrome-1
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-browser-chrome-2
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-browser-chrome-3
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-devtools-chrome-1
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-devtools-chrome-2
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-devtools-chrome-3
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test mochitest-other
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test reftest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound debug test xpcshell
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test cppunit
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test crashtest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test jetpack
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test jittest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test jsreftest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-1
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-2
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-3
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-4
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-5
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-browser-chrome-1
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-browser-chrome-2
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-browser-chrome-3
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-devtools-chrome
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test mochitest-other
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test reftest
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound opt test xpcshell
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound talos chromez
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound talos dromaeojs
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound talos other
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound talos svgr
+ Rev4 MacOSX Snow Leopard 10.6 b2g-inbound talos tp5o
Builders removed
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test cppunit
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test crashtest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test jetpack
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test jittest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test jsreftest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test marionette
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-1
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-2
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-3
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-4
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-5
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-browser-chrome-1
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-browser-chrome-2
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-browser-chrome-3
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-devtools-chrome-1
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-devtools-chrome-2
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-devtools-chrome-3
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test mochitest-other
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test reftest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound debug test xpcshell
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test cppunit
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test crashtest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test jetpack
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test jittest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test jsreftest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-1
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-2
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-3
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-4
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-5
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-browser-chrome-1
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-browser-chrome-2
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-browser-chrome-3
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-devtools-chrome
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test mochitest-other
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test reftest
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound opt test xpcshell
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound talos chromez
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound talos dromaeojs
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound talos other
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound talos svgr
- Rev5 MacOSX Mountain Lion 10.8 b2g-inbound talos tp5o

Comment 6

[Phil Ringnalda (:philor)]

Comment on attachment 8409272 [details] [diff] [review]
[configs] snowleopard

https://hg.mozilla.org/build/buildbot-configs/rev/9aa5118a85a2

Comment 7

[Jordan Lund (:jlund)]

buildbot-config patch live in production: http://hg.mozilla.org/build/buildbot-configs/rev/5fce6d67a084 :)