786424 - Switch off OS X 10.8 on mozilla-esr10 where 10.8 is not a supported platform

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Ed Morley [:emorley]]

In addition to trunk, we're currently running 10.8 on:
* mozilla-esr10
* mozilla-release
* mozilla-beta
* mozilla-aurora

On many of those, some/most of the 10.8 tests fail, so we should switch them off.

Comment 1

[Armen [:armenzg]]

Attachment: disable mountain lion for older release branches

Comment 2

[Armen [:armenzg]]

Attachment: list of builders modified

I see the 10.8 jobs on Aurora but not on Central.
https://tbpl.mozilla.org/?tree=Mozilla-Aurora&jobname=10.8
https://tbpl.mozilla.org/?tree=Firefox&jobname=10.8
I will wait and see who knows why there is this discrepancy.

This shows the different builders that are removed.

This comes from using builder_list.py:
~/repos/releng/braindump/buildbot-related/builder_list.py master.cfg > new

Comment 3

[Ed Morley [:emorley]]

(In reply to Armen Zambrano G. [:armenzg] from comment #2)
> I see the 10.8 jobs on Aurora but not on Central.
> https://tbpl.mozilla.org/?tree=Mozilla-Aurora&jobname=10.8
> https://tbpl.mozilla.org/?tree=Firefox&jobname=10.8
> I will wait and see who knows why there is this discrepancy.

See bug 782826 comment 8.

Comment 4

[Phil Ringnalda (:philor)]

Why are we doing this, and doing it so prematurely? We have absolutely no idea whether or not we're going to be short of 10.8 slaves, since we've never run tests on more than those old release branches. We also have absolutely no idea how difficult it will be to green them up (well, I do, because I greened up 10.7 and many of the changes are the same).

If every bit of every single suite was green, would we be turning these tests off?

Comment 5

[Ed Morley [:emorley]]

Since:
* We won't be backporting much to esr10
* #build said to file the bug
* We can switch the tests back on once we have them green on trunk
* We are short of capacity for now

Happy? :-P

Comment 6

[Phil Ringnalda (:philor)]

Nope, still not happy - we have absolutely, positively no way of knowing whether or not we are short on capacity.

We are not running 10.8 tests anywhere other than beta/release/esr10, because two patches raced. They are pending on aurora because of the way scheduling is weird when you shut a job off and turn it back on, not because of capacity problems. The only way we can find out whether we have capacity problems is to turn them on, and this bug is standing squarely in the way of turning them on.

Comment 7

[Nick Thomas [:nthomas] (UTC+12)]

I agree with philor's analysis of buildbot issues. The reconfig to correct that is happening know, and we'll have a better idea of where we are in the next day or so.

Comment 8

[Ed Morley [:emorley]]

(In reply to Phil Ringnalda (:philor) from comment #6)
> Nope, still not happy - we have absolutely, positively no way of knowing
> whether or not we are short on capacity.

The main reason for filing this wasn't capacity. My fault for mentioning it in one of the bullets in comment 5, without also stating its relative level of priority.

My primary reason for filing this bug was for mozilla-esr10. Again, my fault for last-minute adding in the other repos in comment 0 without emphasising they were a 'maybe/food for thought', and thus complicating the discussion. Trying to hurry to get away from the office at gone 9pm unfortunately has its downsides :-)

Given that ESRs are only slated to support the platforms that were on trunk when they branched, I don't feel we have any need to run 10.8 on ESR. Would it be acceptable to morph this bug to just dealing with ESR10 and we can decide on the others once we have seen more test results/how high the infra load gets?

Comment 9

[Phil Ringnalda (:philor)]

Sweet, I didn't know that esr came with that handy feature. Given that it clearly says no new versions, and the relnotes for 10.0 say 10.5/10.6/10.7, there's no question but what we should shut off the 10.8 tests on esr10.

Comment 10

[Armen [:armenzg]]

Attachment: disable mountain lion for esr10

Comment 11

[Armen [:armenzg]]

Comment on attachment 656548 [details] [diff] [review]
disable mountain lion for esr10

http://hg.mozilla.org/build/buildbot-configs/rev/719da5a25895

Comment 12

[[e-mail] (:bhearsum)]

Made it to production today.

Comment 13

[Ed Morley [:emorley]]

Looks good, thank you :-)