1056787 - Skip every nth job for debug tests on mozilla-inbound

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Chris AtLee [:catlee]]

We'd like to run an experiment where we skip every nth job for debug tests on mozilla-inbound. The purpose of the experiment is to see by how much reducing the test load reduces overall infra load, while at the same time not putting undue burden on sheriffs if and when debug-specific failures arise.

Comment 1

[Chris AtLee [:catlee]]

Ben, what do you think about https://github.com/catlee/buildbotcustom/compare/master...skip_scheduling ?

Comment 2

[[e-mail] (:bhearsum)]

It looks reasonable to me. Almost too easy....

Comment 3

[Chris AtLee [:catlee]]

Attachment: skip_scheduling-buildbotcustom.diff

Comment 4

[Chris AtLee [:catlee]]

Attachment: enable skipping on mozilla-inbound

Comment 5

[[e-mail] (:bhearsum)]

Comment on attachment 8476880 [details] [diff] [review]
enable skipping on mozilla-inbound

Review of attachment 8476880 [details] [diff] [review]:
-----------------------------------------------------------------

r=me if you add a comment about what can break down if you increase skipcount more than the global coalescing limit, per IRC.

Comment 6

[Simone Bruno [:simone]]

In production with reconfig on 2014-08-25 08:49 PT

Comment 7

[Chris AtLee [:catlee]]

Attachment: cleanup

removes MultiScheduler. Wasn't easy to remove the 'tests' count since that's used in some places to disable tests, so I added an 'assert tests == 1' instead.

Comment 8

[[e-mail] (:bhearsum)]

Comment on attachment 8480163 [details] [diff] [review]
cleanup

Review of attachment 8480163 [details] [diff] [review]:
-----------------------------------------------------------------

(In reply to Chris AtLee [:catlee] from comment #7)
> Created attachment 8480163 [details] [diff] [review]
> cleanup
> 
> removes MultiScheduler. Wasn't easy to remove the 'tests' count since that's
> used in some places to disable tests, so I added an 'assert tests == 1'
> instead.

It seems that this is possible by setting tests = 0 or removing the slave platform.

> python -mthis | tail -n7 | head -n1
> There should be one-- and preferably only one --obvious way to do it.

Oh well...

Comment 9

[Jordan Lund (:jlund)]

patch(es) in production :)