836454 - Android l10n jobs need to purge_builds so they don't run out of space

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Phil Ringnalda (:philor)]

http://ftp.mozilla.org/pub/mozilla.org/mobile/tinderbox-builds/mozilla-aurora-l10n/mozilla-aurora-android-l10n_1-unknown-bm49-build1-build27.txt.gz ran out of space, and then the next ~50 jobs on that slave died.

Comment 1

[Aki Sasaki (not active)]

Attachment: log from staging android nightly l10n with purge

Comment 2

[Aki Sasaki (not active)]

Attachment: add PurgeMixin.clobber() to mobile_l10n.py

See the attached [partial] log.
The query_is_nightly() workaround isn't great, but we're not currently doing depend builds here.

Comment 3

[Aki Sasaki (not active)]

Massimo: FYI, I'm changing how mobile_l10n.py behaves a bit, for clobbers.

Comment 4

[Chris AtLee [:catlee]]

Comment on attachment 743273 [details] [diff] [review]
add PurgeMixin.clobber() to mobile_l10n.py

Review of attachment 743273 [details] [diff] [review]:
-----------------------------------------------------------------

::: scripts/mobile_l10n.py
@@ +285,5 @@
> +    def query_is_nightly(self):
> +        """ Override BuildbotMixin.query_is_nightly() because we have no "nightly_build" buildbot property.
> +        """
> +        if self.config.get("is_automation"):
> +            return True

instead of overriding this, can we set 'force_clobber' in the config? does that achieve the same result?

Comment 5

[Aki Sasaki (not active)]

Attachment: with force_clobber

I think it does.
This is fine for mobile, where we just do release/nightly repacks.  We'll need a real solution for desktop, where we have depend repacks... most likely the nightly_build property.

Comment 6

[Aki Sasaki (not active)]

Comment on attachment 744272 [details] [diff] [review]
with force_clobber

https://hg.mozilla.org/build/mozharness/rev/03d173018e0f

Comment 7

[Aki Sasaki (not active)]

Merged to production.

Comment 8

[Aki Sasaki (not active)]

Respun a couple l10n nightlies, and they've run purge_builds.