Closed Bug 488368 Opened 13 years ago Closed 13 years ago

Set up new buildbot master for pool of talos slaves

Categories

(Release Engineering :: General, defect, P2)

x86
Linux
defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: catlee, Assigned: catlee)

References

Details

Attachments

(4 files, 2 obsolete files)

The new master should live on qm-rhel02, and go into
/build/perfmaster-pool

It should get its own files in buildbot-configs as well.
Blocks: 488370
Blocks: 488372
Blocks: 488378
While we are setting up this new master anyway, could we do it on a different freshly created VM or else can we rename qm-rhel02?

"production-talos-master.b.m.o" or "talos-master.b.m.o" would be much more intuitive, imho.
I'd be happy with talos-master.m.o.  The talos machines don't live in the build network.

We could set up a CNAME from talos-master.m.o -> qm-rhel02.m.o, or from qm-rhel02.m.o -> talos-master.m.o to make the transition easier.

Talos Try also runs on this machine, so "production-talos-master" isn't really appropriate...unless we set up another CNAME from try-talos-master.m.o -> talos-master.m.o.
Assignee: nobody → catlee
Priority: -- → P2
On second thought, we should spin up new VMs for this.

Will file secondary bugs for new VMs for talos-master.m.o and talos-staging-master.m.o.
Depends on: 488530
We need an upgraded buildbot since it has a fix for FIFO build processing when slaves connect.  Since slaves are constantly disconnecting / reconnecting in Talos, this is vital to have.

We could also consider backporting the fix to our 0.7.9 version of buildbot.
Depends on: 481886
Going to steal this from Catlee (with permission).
Assignee: catlee → bhearsum
Status: NEW → ASSIGNED
Alright, post-install is done on talos-master and talos-staging-master. I also removed /builds/scratchbox since we have no use for it on a Buildbot master. I didn't bother cloning buildbot-configs since the new ones aren't there yet, anything else you'd like me to do, catlee?
Off to catlee for the rest.
Assignee: bhearsum → catlee
Both masters have buildbot set up and running.  The rest is should just be configuration tweaks.
Attachment #376289 - Flags: review?(anodelman)
Comment on attachment 376289 [details] [diff] [review]
Buildbot configs for staging pool

+                       sendToInterestedUsers=False,
+                       extraRecipients=["anodelman@mozilla.com"]

Somehow, I don't think that I want to be getting this mail.  Maybe pull this out.
Attachment #376289 - Flags: review?(anodelman) → review+
(In reply to comment #10)
> (From update of attachment 376289 [details] [diff] [review])
> +                       sendToInterestedUsers=False,
> +                       extraRecipients=["anodelman@mozilla.com"]
> 
> Somehow, I don't think that I want to be getting this mail.  Maybe pull this
> out.
Funny.


catlee: Could you add me to that? Or maybe build-announce? 

At least for the first while of using the new pool-of-talos-slaves, I would be interested in getting these to see how it is going. After a while of working routinely, I'd probably be back asking to get removed, and rely on some nagios alerts instead.
Pretty much the same as before, except adding more slaves to the list, disable mail to people on failure, enabling build-skipping on all branches, and fixing up the buildbot categories.
Attachment #376289 - Attachment is obsolete: true
Attachment #378457 - Flags: review?(anodelman)
Build request merging is enabled here to start with.  The plan is to disable merging for the primary branches at the very least once we have enough slaves in the pool.
Attachment #378460 - Flags: review?(anodelman)
Depends on: 448047
Attachment #378460 - Attachment is obsolete: true
Attachment #378460 - Flags: review?(anodelman)
Same as before, except set up Tinderbox reporting properly
Attachment #378658 - Flags: review?(anodelman)
Attachment #378457 - Flags: review?(anodelman) → review+
Comment on attachment 378658 [details] [diff] [review]
Buildbot configs for production pool

Why does the pool need a copy of the ftppoller?
Attachment #378658 - Flags: review?(anodelman) → review+
Comment on attachment 378658 [details] [diff] [review]
Buildbot configs for production pool

Cleared up over irc, required for testing Firefox3.0.
Comment on attachment 378457 [details] [diff] [review]
Buildbot configs for staging pool

changeset:   1159:7dbd08467cb1
Attachment #378457 - Flags: checked‑in+
Attachment #378658 - Flags: checked‑in+
Comment on attachment 378658 [details] [diff] [review]
Buildbot configs for production pool

changeset:   1160:ff0e933fd060
Both masters are up and running.  Any future problems should go into new bugs.
Status: ASSIGNED → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Attachment #379156 - Flags: review?(bhearsum)
Attachment #379156 - Flags: review?(bhearsum) → review+
Comment on attachment 379156 [details] [diff] [review]
Fix tinderbox reporting

changeset:   1168:828d023f06e4
Attachment #379156 - Flags: checked‑in+
Attachment #380432 - Flags: review?(anodelman)
Attachment #380432 - Flags: review?(anodelman) → review+
Attachment #380432 - Flags: checked‑in+
Comment on attachment 380432 [details] [diff] [review]
Enable symbol fetching on nochrome tests

changeset:   1204:31a2c07eba9f
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.