1613283 - Rotate scriptworker log on mac-v3-signing pool

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: Puppet, task)

Description

[Nick Thomas [:nthomas] (UTC+12)]

The scriptworker log will grow unbounded on the mac-v3-signing machines, eg mac-v3-signing12 accumulated 1.2G of messages over the 6 months to now. They have big enough disks that this isn't going to break them soon but it will be a problem at some point in the future.

Looks like we kept 10 days of history on our old AWS scriptworkers which seems fine for this too.

We will need to cope with the multiple paths
/builds/scriptworker/logs/worker.log
/builds/dep1/logs/worker.log
/builds/dep2/logs/worker.log
/builds/tb-dep/logs/worker.log
and lack of logrotate on mac.

Comment 1

[Aki Sasaki (not active)]

Back in the old days, we had a RotatingFileHandler. Reimplementing that behind an option, for the mac signers only, may be one solution here. (Docs for RotatingFileHandler)

Comment 2

[ablew]

backlog cleanup

Comment 3

[Julien Cristau [:jcristau]]

Attachment: GitHub Pull Request

Comment 4

[Heitor Neiva [:hneiva]]

PRs:
https://github.com/mozilla-releng/scriptworker/pull/528

https://github.com/mozilla-platform-ops/ronin_puppet/pull/373

https://github.com/mozilla-releng/scriptworker-scripts/pull/475