1148736 - Mozharness desktop l10n jobs need to free up enough space to run before they run

Status: RESOLVED FIXED

(Release Engineering :: Applications: MozharnessCore, defect)

Description

[Phil Ringnalda (:philor)]

The set in https://treeherder.mozilla.org/#/jobs?repo=ash&revision=a87d5c89f249 took out two Windows build slaves, since we still rather foolishly expect that every job will leave enough space for the next job to clone tools before it frees up enough space to run.

Comment 1

[Massimo Gervasini [:massimo]]

Attachment: [mozharness] Bug 1148736 - Mozharness desktop l10n jobs need to free up enough space to run before they run.patch

changes in this patch:

* added a call to PurgeMixin.clobber()
* added to ash.py and mozilla-central.py configuration files: 
   is_automation = True
   purge_minsize = 12


Here's the log output:

INFO - #####
INFO - ##### Running clobber step.
INFO - #####
INFO - Running main action method: clobber
INFO - rmtree: c:\builds\moz2_slave\WINNT-5.2-ash-l10n-1_10-000000\build\ash\obj-l10n
INFO - Using _rmtree_windows ...
INFO - retry: ...
INFO - rmtree: c:\builds\moz2_slave\WINNT-5.2-ash-l10n-1_10-000000\build\compare-locales
INFO - Using _rmtree_windows ...
INFO - retry: ....
INFO - rmtree: c:\builds\moz2_slave\WINNT-5.2-ash-l10n-1_10-000000\build\upload
INFO - Using _rmtree_windows ...
INFO - retry: ...
INFO - Running command: ['python', 'c:\\builds\\moz2_slave\\WINNT-5.2-ash-l10n-1_10-000000\\scripts\\external_tools\\purge_builds.py', '-s', '12', '--max-age', '14', '--not', 'info', '--not', 'rel-*', '--not', 'tb-rel-*', 'c:\\builds\\moz2_slave']
INFO - Copy/paste: python c:\builds\moz2_slave\WINNT-5.2-ash-l10n-1_10-000000\scripts\external_tools\purge_builds.py -s 12 --max-age 14 --not info --not rel-* --not tb-rel-* c:\builds\moz2_slave
INFO - Using env: {'HG_SHARE_BASE_DIR': 'c:/builds/hg-shared',
INFO -  'PATH': 'C:\\mozilla-build.... }
INFO -  158.63 GB of space available

full log here: http://dev-master2.bb.releng.use1.mozilla.com:8914/builders/WINNT%205.2%20ash%20nightly%20l10n%201%2F10/builds/128/steps/run_script/logs/stdio (requires VPN)

Comment 2

[Massimo Gervasini [:massimo]]

Comment on attachment 8585519 [details] [diff] [review]
[mozharness] Bug 1148736 - Mozharness desktop l10n jobs need to free up enough space to run before they run.patch

Thanks rail!


https://hg.mozilla.org/build/mozharness/rev/7e4c5e72d47f

Comment 3

[Jordan Lund (:jlund)]

mozharness production tag moved to: https://hg.mozilla.org/build/mozharness/rev/production

Comment 4

[Massimo Gervasini [:massimo]]

We did not hit the disk space issue anymore. Closing this bug.