Skip every nth job for debug tests on mozilla-inbound

RESOLVED FIXED

Status

Release Engineering
General Automation
RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: catlee, Assigned: catlee)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(3 attachments)

(Assignee)

Description

3 years ago
We'd like to run an experiment where we skip every nth job for debug tests on mozilla-inbound. The purpose of the experiment is to see by how much reducing the test load reduces overall infra load, while at the same time not putting undue burden on sheriffs if and when debug-specific failures arise.
(Assignee)

Comment 1

3 years ago
Ben, what do you think about https://github.com/catlee/buildbotcustom/compare/master...skip_scheduling ?
Flags: needinfo?(bhearsum)
It looks reasonable to me. Almost too easy....
Flags: needinfo?(bhearsum)
(Assignee)

Comment 3

3 years ago
Created attachment 8476879 [details] [diff] [review]
skip_scheduling-buildbotcustom.diff
Attachment #8476879 - Flags: review?(bhearsum)
(Assignee)

Comment 4

3 years ago
Created attachment 8476880 [details] [diff] [review]
enable skipping on mozilla-inbound
Attachment #8476880 - Flags: review?(bhearsum)
Attachment #8476879 - Flags: review?(bhearsum) → review+
Comment on attachment 8476880 [details] [diff] [review]
enable skipping on mozilla-inbound

Review of attachment 8476880 [details] [diff] [review]:
-----------------------------------------------------------------

r=me if you add a comment about what can break down if you increase skipcount more than the global coalescing limit, per IRC.
Attachment #8476880 - Flags: review?(bhearsum) → review+
(Assignee)

Updated

3 years ago
Attachment #8476879 - Flags: checked-in+
(Assignee)

Updated

3 years ago
Attachment #8476880 - Flags: checked-in+
In production with reconfig on 2014-08-25 08:49 PT
(Assignee)

Comment 7

3 years ago
Created attachment 8480163 [details] [diff] [review]
cleanup

removes MultiScheduler. Wasn't easy to remove the 'tests' count since that's used in some places to disable tests, so I added an 'assert tests == 1' instead.
Attachment #8480163 - Flags: review?(bhearsum)
Comment on attachment 8480163 [details] [diff] [review]
cleanup

Review of attachment 8480163 [details] [diff] [review]:
-----------------------------------------------------------------

(In reply to Chris AtLee [:catlee] from comment #7)
> Created attachment 8480163 [details] [diff] [review]
> cleanup
> 
> removes MultiScheduler. Wasn't easy to remove the 'tests' count since that's
> used in some places to disable tests, so I added an 'assert tests == 1'
> instead.

It seems that this is possible by setting tests = 0 or removing the slave platform.

> python -mthis | tail -n7 | head -n1
> There should be one-- and preferably only one --obvious way to do it.

Oh well...
Attachment #8480163 - Flags: review?(bhearsum) → review+
patch(es) in production :)
(Assignee)

Updated

3 years ago
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.