1356333 - Add metadata to builders to identify them as orphan

Status: RESOLVED FIXED

(Release Engineering :: General, enhancement)

Description

[Armen [:armenzg]]

We have some downstream builders that do not have a Buildbot build job to trigger them (Linux64 talos jobs). These jobs are scheduled via TaskCluster with the BBB.

In order to allow scheduling these jobs out of band via TaskCluster we need to mark the Buildbot builders to not show up on the runnable_jobs API.

In this bug we want to add some metadata for these fatherless builders which would show up in allthethings.json (runnable_jobs' data is build based on it). TH will then ignore fatherless builders.

Comment 1

[Armen [:armenzg]]

This is the current list of builder my patch affects [1].
Version 53 was picked based on https://hg.mozilla.org/build/buildbot-configs/file/default/mozilla/config.py#l2757

[1] Current list of builders that will have 'skip_runnable_jobs':
Ubuntu HW 12.04 x64 autoland talos chromez
Ubuntu HW 12.04 x64 autoland talos chromez-e10s
Ubuntu HW 12.04 x64 autoland talos dromaeojs
Ubuntu HW 12.04 x64 autoland talos dromaeojs-e10s
Ubuntu HW 12.04 x64 autoland talos g1
Ubuntu HW 12.04 x64 autoland talos g1-e10s
Ubuntu HW 12.04 x64 autoland talos g2
Ubuntu HW 12.04 x64 autoland talos g2-e10s
Ubuntu HW 12.04 x64 autoland talos g3
Ubuntu HW 12.04 x64 autoland talos g3-e10s
Ubuntu HW 12.04 x64 autoland talos g4
Ubuntu HW 12.04 x64 autoland talos g4-e10s
Ubuntu HW 12.04 x64 autoland talos other
Ubuntu HW 12.04 x64 autoland talos other-e10s
Ubuntu HW 12.04 x64 autoland talos perf-reftest
Ubuntu HW 12.04 x64 autoland talos perf-reftest-e10s
Ubuntu HW 12.04 x64 autoland talos svgr
Ubuntu HW 12.04 x64 autoland talos svgr-e10s
Ubuntu HW 12.04 x64 autoland talos tp5o
Ubuntu HW 12.04 x64 autoland talos tp5o-e10s
Ubuntu HW 12.04 x64 cedar talos chromez
Ubuntu HW 12.04 x64 cedar talos chromez-e10s
Ubuntu HW 12.04 x64 cedar talos dromaeojs
Ubuntu HW 12.04 x64 cedar talos dromaeojs-e10s
Ubuntu HW 12.04 x64 cedar talos g1
Ubuntu HW 12.04 x64 cedar talos g1-e10s
Ubuntu HW 12.04 x64 cedar talos g2
Ubuntu HW 12.04 x64 cedar talos g2-e10s
Ubuntu HW 12.04 x64 cedar talos g3
Ubuntu HW 12.04 x64 cedar talos g3-e10s
Ubuntu HW 12.04 x64 cedar talos g4
Ubuntu HW 12.04 x64 cedar talos g4-e10s
Ubuntu HW 12.04 x64 cedar talos other
Ubuntu HW 12.04 x64 cedar talos other-e10s
Ubuntu HW 12.04 x64 cedar talos perf-reftest
Ubuntu HW 12.04 x64 cedar talos perf-reftest-e10s
Ubuntu HW 12.04 x64 cedar talos svgr
Ubuntu HW 12.04 x64 cedar talos svgr-e10s
Ubuntu HW 12.04 x64 cedar talos tp5o
Ubuntu HW 12.04 x64 cedar talos tp5o-e10s
Ubuntu HW 12.04 x64 larch talos chromez
Ubuntu HW 12.04 x64 larch talos chromez-e10s
Ubuntu HW 12.04 x64 larch talos dromaeojs
Ubuntu HW 12.04 x64 larch talos dromaeojs-e10s
Ubuntu HW 12.04 x64 larch talos g1
Ubuntu HW 12.04 x64 larch talos g1-e10s
Ubuntu HW 12.04 x64 larch talos g2
Ubuntu HW 12.04 x64 larch talos g2-e10s
Ubuntu HW 12.04 x64 larch talos g3
Ubuntu HW 12.04 x64 larch talos g3-e10s
Ubuntu HW 12.04 x64 larch talos g4
Ubuntu HW 12.04 x64 larch talos g4-e10s
Ubuntu HW 12.04 x64 larch talos other
Ubuntu HW 12.04 x64 larch talos other-e10s
Ubuntu HW 12.04 x64 larch talos perf-reftest
Ubuntu HW 12.04 x64 larch talos perf-reftest-e10s
Ubuntu HW 12.04 x64 larch talos svgr
Ubuntu HW 12.04 x64 larch talos svgr-e10s
Ubuntu HW 12.04 x64 larch talos tp5o
Ubuntu HW 12.04 x64 larch talos tp5o-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos chromez
Ubuntu HW 12.04 x64 mozilla-aurora talos chromez-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos dromaeojs
Ubuntu HW 12.04 x64 mozilla-aurora talos dromaeojs-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos g1
Ubuntu HW 12.04 x64 mozilla-aurora talos g1-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos g2
Ubuntu HW 12.04 x64 mozilla-aurora talos g2-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos g3
Ubuntu HW 12.04 x64 mozilla-aurora talos g3-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos g4
Ubuntu HW 12.04 x64 mozilla-aurora talos g4-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos other
Ubuntu HW 12.04 x64 mozilla-aurora talos other-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos svgr
Ubuntu HW 12.04 x64 mozilla-aurora talos svgr-e10s
Ubuntu HW 12.04 x64 mozilla-aurora talos tp5o
Ubuntu HW 12.04 x64 mozilla-aurora talos tp5o-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos chromez
Ubuntu HW 12.04 x64 mozilla-beta talos chromez-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos dromaeojs
Ubuntu HW 12.04 x64 mozilla-beta talos dromaeojs-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos g1
Ubuntu HW 12.04 x64 mozilla-beta talos g1-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos g2
Ubuntu HW 12.04 x64 mozilla-beta talos g2-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos g3
Ubuntu HW 12.04 x64 mozilla-beta talos g3-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos g4
Ubuntu HW 12.04 x64 mozilla-beta talos g4-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos other
Ubuntu HW 12.04 x64 mozilla-beta talos other-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos svgr
Ubuntu HW 12.04 x64 mozilla-beta talos svgr-e10s
Ubuntu HW 12.04 x64 mozilla-beta talos tp5o
Ubuntu HW 12.04 x64 mozilla-beta talos tp5o-e10s
Ubuntu HW 12.04 x64 mozilla-central talos chromez
Ubuntu HW 12.04 x64 mozilla-central talos chromez-e10s
Ubuntu HW 12.04 x64 mozilla-central talos dromaeojs
Ubuntu HW 12.04 x64 mozilla-central talos dromaeojs-e10s
Ubuntu HW 12.04 x64 mozilla-central talos g1
Ubuntu HW 12.04 x64 mozilla-central talos g1-e10s
Ubuntu HW 12.04 x64 mozilla-central talos g2
Ubuntu HW 12.04 x64 mozilla-central talos g2-e10s
Ubuntu HW 12.04 x64 mozilla-central talos g3
Ubuntu HW 12.04 x64 mozilla-central talos g3-e10s
Ubuntu HW 12.04 x64 mozilla-central talos g4
Ubuntu HW 12.04 x64 mozilla-central talos g4-e10s
Ubuntu HW 12.04 x64 mozilla-central talos other
Ubuntu HW 12.04 x64 mozilla-central talos other-e10s
Ubuntu HW 12.04 x64 mozilla-central talos perf-reftest
Ubuntu HW 12.04 x64 mozilla-central talos perf-reftest-e10s
Ubuntu HW 12.04 x64 mozilla-central talos svgr
Ubuntu HW 12.04 x64 mozilla-central talos svgr-e10s
Ubuntu HW 12.04 x64 mozilla-central talos tp5o
Ubuntu HW 12.04 x64 mozilla-central talos tp5o-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos chromez
Ubuntu HW 12.04 x64 mozilla-inbound talos chromez-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos dromaeojs
Ubuntu HW 12.04 x64 mozilla-inbound talos dromaeojs-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos g1
Ubuntu HW 12.04 x64 mozilla-inbound talos g1-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos g2
Ubuntu HW 12.04 x64 mozilla-inbound talos g2-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos g3
Ubuntu HW 12.04 x64 mozilla-inbound talos g3-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos g4
Ubuntu HW 12.04 x64 mozilla-inbound talos g4-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos other
Ubuntu HW 12.04 x64 mozilla-inbound talos other-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos perf-reftest
Ubuntu HW 12.04 x64 mozilla-inbound talos perf-reftest-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos svgr
Ubuntu HW 12.04 x64 mozilla-inbound talos svgr-e10s
Ubuntu HW 12.04 x64 mozilla-inbound talos tp5o
Ubuntu HW 12.04 x64 mozilla-inbound talos tp5o-e10s
Ubuntu HW 12.04 x64 pine talos chromez
Ubuntu HW 12.04 x64 pine talos chromez-e10s
Ubuntu HW 12.04 x64 pine talos dromaeojs
Ubuntu HW 12.04 x64 pine talos dromaeojs-e10s
Ubuntu HW 12.04 x64 pine talos g1
Ubuntu HW 12.04 x64 pine talos g1-e10s
Ubuntu HW 12.04 x64 pine talos g2
Ubuntu HW 12.04 x64 pine talos g2-e10s
Ubuntu HW 12.04 x64 pine talos g3
Ubuntu HW 12.04 x64 pine talos g3-e10s
Ubuntu HW 12.04 x64 pine talos g4
Ubuntu HW 12.04 x64 pine talos g4-e10s
Ubuntu HW 12.04 x64 pine talos other
Ubuntu HW 12.04 x64 pine talos other-e10s
Ubuntu HW 12.04 x64 pine talos perf-reftest
Ubuntu HW 12.04 x64 pine talos perf-reftest-e10s
Ubuntu HW 12.04 x64 pine talos svgr
Ubuntu HW 12.04 x64 pine talos svgr-e10s
Ubuntu HW 12.04 x64 pine talos tp5o
Ubuntu HW 12.04 x64 pine talos tp5o-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos chromez
Ubuntu HW 12.04 x64 stylo mozilla-central talos chromez-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos dromaeojs
Ubuntu HW 12.04 x64 stylo mozilla-central talos dromaeojs-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos g1
Ubuntu HW 12.04 x64 stylo mozilla-central talos g1-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos g2
Ubuntu HW 12.04 x64 stylo mozilla-central talos g2-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos g3
Ubuntu HW 12.04 x64 stylo mozilla-central talos g3-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos g4
Ubuntu HW 12.04 x64 stylo mozilla-central talos g4-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos other
Ubuntu HW 12.04 x64 stylo mozilla-central talos other-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos perf-reftest
Ubuntu HW 12.04 x64 stylo mozilla-central talos perf-reftest-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos svgr
Ubuntu HW 12.04 x64 stylo mozilla-central talos svgr-e10s
Ubuntu HW 12.04 x64 stylo mozilla-central talos tp5o
Ubuntu HW 12.04 x64 stylo mozilla-central talos tp5o-e10s
Ubuntu HW 12.04 x64 stylo try talos chromez
Ubuntu HW 12.04 x64 stylo try talos chromez-e10s
Ubuntu HW 12.04 x64 stylo try talos dromaeojs
Ubuntu HW 12.04 x64 stylo try talos dromaeojs-e10s
Ubuntu HW 12.04 x64 stylo try talos g1
Ubuntu HW 12.04 x64 stylo try talos g1-e10s
Ubuntu HW 12.04 x64 stylo try talos g2
Ubuntu HW 12.04 x64 stylo try talos g2-e10s
Ubuntu HW 12.04 x64 stylo try talos g3
Ubuntu HW 12.04 x64 stylo try talos g3-e10s
Ubuntu HW 12.04 x64 stylo try talos g4
Ubuntu HW 12.04 x64 stylo try talos g4-e10s
Ubuntu HW 12.04 x64 stylo try talos other
Ubuntu HW 12.04 x64 stylo try talos other-e10s
Ubuntu HW 12.04 x64 stylo try talos perf-reftest
Ubuntu HW 12.04 x64 stylo try talos perf-reftest-e10s
Ubuntu HW 12.04 x64 stylo try talos svgr
Ubuntu HW 12.04 x64 stylo try talos svgr-e10s
Ubuntu HW 12.04 x64 stylo try talos tp5o
Ubuntu HW 12.04 x64 stylo try talos tp5o-e10s
Ubuntu HW 12.04 x64 try talos chromez
Ubuntu HW 12.04 x64 try talos chromez-e10s
Ubuntu HW 12.04 x64 try talos dromaeojs
Ubuntu HW 12.04 x64 try talos dromaeojs-e10s
Ubuntu HW 12.04 x64 try talos g1
Ubuntu HW 12.04 x64 try talos g1-e10s
Ubuntu HW 12.04 x64 try talos g2
Ubuntu HW 12.04 x64 try talos g2-e10s
Ubuntu HW 12.04 x64 try talos g3
Ubuntu HW 12.04 x64 try talos g3-e10s
Ubuntu HW 12.04 x64 try talos g4
Ubuntu HW 12.04 x64 try talos g4-e10s
Ubuntu HW 12.04 x64 try talos other
Ubuntu HW 12.04 x64 try talos other-e10s
Ubuntu HW 12.04 x64 try talos perf-reftest
Ubuntu HW 12.04 x64 try talos perf-reftest-e10s
Ubuntu HW 12.04 x64 try talos svgr
Ubuntu HW 12.04 x64 try talos svgr-e10s
Ubuntu HW 12.04 x64 try talos tp5o
Ubuntu HW 12.04 x64 try talos tp5o-e10s

Comment 2

[Armen [:armenzg]]

Attachment: [buildbot-configs] add 'skip_runnable_jobs' for Linux Talos builders up to version Fx53

Comment 3

[Armen [:armenzg]]

Attachment: [buildbotcustom] pass 'skip_runnable_jobs' around

Comment 4

[Armen [:armenzg]]

Attachment: [braindump] pass 'skip_runnable_jobs' around

Comment 5

[Armen [:armenzg]]

Attachment: allthethings.json - with skip_runnable_jobs

This can be generated by running this script:
~/.mozilla/releng/repos/braindump/buildbot-related/dump_allthethings.sh

Set up instructions are here:
https://github.com/armenzg/releng_buildbot_docker

Repos to be patched are under here:
/root/.mozilla/releng/repos

Comment 6

[Armen [:armenzg]]

Comment on attachment 8860076 [details] [diff] [review]
[buildbot-configs] add 'skip_runnable_jobs' for Linux Talos builders up to version Fx53

We won't need to skip the Talos builders anymore. I found I can't fix the issue the way I originally planned.

We can still used this work to fix bug 1274483 (do not allow scheduling nightly builders via "add new jobs" until it is fixed).

Comment 7

[Armen [:armenzg]]

Thanks kmoir!

For some reason I can't figure out why I can't push to the build repositories.
Would you mind landing these for me until I figure out my issues?


--- Commit message ---
Bug 1356333 - Support 'skip_runnable_jobs' parameter for builders. r=kmoir

This is to be used by the Treeherder runnable jobs API to exclude Buildbot builders from showing up.

Comment 8

[Kim Moir [:kmoir] ET]

I will land them on Monday, paranoid about landing on late Friday :-)  Adding a ni as a reminder to me.

Comment 9

[Armen [:armenzg]]

Thank you Kim!