Closed Bug 611846 Opened 14 years ago Closed 14 years ago

Ensure that moved minis to SCL have puppet and OPSI up-to-date

Categories

(Release Engineering :: General, defect, P2)

Product:
Release Engineering
Component:
General
Platform:
x86
macOS
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 612288

People

(Reporter: armenzg, Assigned: armenzg)

References

Details

(Whiteboard: [puppet])

In bug 611441, due to too much going on and machines not being online in time at SCL we decided not to update to which puppet master the minis should talk to. We should fix this next week. I will volunteer for this but anyone is welcome to take it or help.
The downside of leaving this over the weekend is that the /var partition on mv-production-puppet got filled up. There is a continuous stream of messages like this in /var/log/messages: Nov 14 14:51:55 mv-production-puppet puppetmasterd[21684]: (mount[production]) talos-r3-snow-017.build.mozilla.org cannot access /production/darwin10-i386/test/Users/cltbld/cscreen Nov 14 14:51:55 mv-production-puppet puppetmasterd[21684]: Permission denied: Cannot access mount[production] Nov 14 14:51:55 mv-production-puppet puppetmasterd[21774]: (mount[production]) defaulting to no access for talos-r3-snow-017.build.mozilla.org I've compressed some logs to get some disk back (in particular /var/log/httpd/*.? and /var/log/messages.1). Bug 612177 to fill in the holes in nagios coverage that didn't alert us to the problem.
There's a local modification in /etc/puppet/manifests that allows SCL IPs at MV. This _must_ be removed after all the slaves are swapped over to the correct master.
I've removed that local modification. There's still lots of 'puppetca --clean' messages so it didn't help much with the log turning over.
Priority: -- → P2
Whiteboard: [puppet]
See Also: → 612288
The slaves are being dealt with in bug 612288. nthomas: anything else left on this bug?
We should learn the lesson of comment #1, noting the machines should have been set up to talk to the right puppet master before shutdown in MV, as we did for the previous moves. And dupe to where the actual work was done.
Status: ASSIGNED → RESOLVED
Closed: 14 years ago
Resolution: --- → DUPLICATE
Right. I have learned it the hard way.
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.