1141534 - Mulet nightly builds have incorrect automation mozconfigs

Status: RESOLVED FIXED

(Release Engineering :: Applications: MozharnessCore, defect)

Description

[Michael Shal [:mshal]]

In bug 1132123 we moved mulet builds over to mozharness. The mulet mozconfigs are based on the browser mozconfigs, which set MOZ_AUTOMATION_UPLOAD_SYMBOLS=1 and MOZ_AUTOMATION_UPDATE_PACKAGING=1 when IS_NIGHTLY=yes. However, we don't want to do uploadsymbols and update-packaging for mulet, and the nightly builds break when it tries to do so.

We'll need to update the mulet mozconfigs to force these to zero, and the browser mozconfigs to default to 1 if not set.

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1140785
repository: mozilla-central
start_time: 2015-03-10T05:35:27
who: tomcat[at]mozilla[dot]com
machine: b-2008-ix-0014
buildname: Win32 Mulet mozilla-central nightly
revision: 6686aacf006f

Return code: 1
'mach build' did not run successfully. Please check log for errors.
Running post_fatal callback...
Exiting -1
# TBPL FAILURE #
# TBPL FAILURE #

Comment 2

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1140788
repository: mozilla-central
start_time: 2015-03-10T05:34:16
who: tomcat[at]mozilla[dot]com
machine: bld-lion-r5-067
buildname: OS X Mulet mozilla-central nightly
revision: 6686aacf006f

make[1]: *** [uploadsymbols] Error 1
make: *** [automation/uploadsymbols] Error 2
Return code: 2
'mach build' did not run successfully. Please check log for errors.
Running post_fatal callback...
Exiting -1
# TBPL FAILURE #
# TBPL FAILURE #

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1140787
repository: mozilla-central
start_time: 2015-03-10T05:35:51
who: tomcat[at]mozilla[dot]com
machine: bld-linux64-spot-265
buildname: Linux x86-64 Mulet mozilla-central nightly
revision: 6686aacf006f

gmake[1]: *** [uploadsymbols] Error 1
gmake: *** [automation/uploadsymbols] Error 2
Return code: 2
'mach build' did not run successfully. Please check log for errors.
Running post_fatal callback...
Exiting -1
# TBPL FAILURE #
# TBPL FAILURE #

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1140786
repository: mozilla-central
start_time: 2015-03-10T05:36:42
who: tomcat[at]mozilla[dot]com
machine: b-2008-ix-0154
buildname: Win32 Mulet mozilla-central nightly
revision: 6686aacf006f

Return code: 1
'mach build' did not run successfully. Please check log for errors.
Running post_fatal callback...
Exiting -1
# TBPL FAILURE #
# TBPL FAILURE #

Comment 6

[Michael Shal [:mshal]]

Attachment: mulet-disable-updates

We don't want to do balrog updates for mulet builds, so delete the 'update' action. I also got rid of the other commented-out actions.

Comment 7

[Michael Shal [:mshal]]

Attachment: mulet-nightly

mozconfig updates to disable uploadsymbols and update-packaging for mulet builds.

Comment 8

[Michael Shal [:mshal]]

https://hg.mozilla.org/integration/mozilla-inbound/rev/062749867598

Comment 9

[Michael Shal [:mshal]]

leave-open until mozharness is updated

Comment 10

[Phil Ringnalda (:philor)]

Is there something else that needs to be set still? That did get merged to mozilla-central, though it didn't get marked, but while http://ftp.mozilla.org/pub/mozilla.org/b2g/nightly/2015/03/2015-03-11-01-02-31-mozilla-central/mozilla-central-linux64-mulet-nightly-bm77-build1-build15.txt.gz says it used a mozconfig with MOZ_AUTOMATION_UPDATE_PACKAGING=0, it (and all the other Mulet nightlies) still failed while trying to submit its nonexistent update to Balrog.

Comment 11

[Michael Shal [:mshal]]

Yeah, the second patch on this bug is for mozharness, which disables trying to send the updates to balrog since we don't need that for mulet. After that, mulet nightlies should be green according to my staging tests.

Comment 12

[Ekanan Ketunuti]

https://hg.mozilla.org/mozilla-central/rev/062749867598

Comment 13

[Jordan Lund (:jlund)]

Comment on attachment 8575442 [details] [diff] [review]
mulet-disable-updates

Review of attachment 8575442 [details] [diff] [review]:
-----------------------------------------------------------------

<stamp>

Comment 14

[Michael Shal [:mshal]]

Comment on attachment 8575442 [details] [diff] [review]
mulet-disable-updates

https://hg.mozilla.org/build/mozharness/rev/a603f0c284a6

Comment 15

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

After https://hg.mozilla.org/mozilla-central/rev/062749867598 landed mulet nightlies are still failing, just differently:
https://treeherder.mozilla.org/logviewer.html#?job_id=1146542&repo=mozilla-central


Will https://hg.mozilla.org/build/mozharness/rev/a603f0c284a6 fix it?

Comment 16

[Michael Shal [:mshal]]

It should, yeah. I'm running that on try now, and if that looks good I'll push an update to inbound to use the latest mozharness.

Comment 17

[Michael Shal [:mshal]]

m-c is now using the mozharness fix, so if the next set of mulet nightlies doesn't work, then something else is broken. Please ping me if that's the case!

Comment 18

[Chris Cooper [:coop] (he/him)]

mozharness production tag moved to: https://hg.mozilla.org/build/mozharness/rev/d35bfd399151

Comment 19

[Michael Shal [:mshal]]

Mulet nightlies are green now, closing.

Comment 20

[Firefox Bug Husbandry Bot]

Removing leave-open keyword from resolved bugs, per :sylvestre.