725294 - mozconfig comparison doesn't work for mobile

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[[e-mail] (:bhearsum)]

This may have broken when we switched to in-tree mozconfigs, or it may have never worked. Here's the errors that release_sanity.py throws:
2012-02-08 05:48:01,079 : INFO : Comparing fennec mozconfigs to nightly mozconfigs...
2012-02-08 05:48:08,950 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-release/raw-file/18ce5e304e97/mobile/config/mozconfigs/macosx-desktop/release - ERROR: Not Found
2012-02-08 05:48:16,047 : INFO : Missing mozconfigs to compare for macosx-mobile
2012-02-08 05:48:23,919 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-release/raw-file/18ce5e304e97/mobile/config/mozconfigs/win32-desktop/release - ERROR: Not Found
2012-02-08 05:48:31,169 : INFO : Missing mozconfigs to compare for win32-mobile
2012-02-08 05:48:38,205 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-release/raw-file/18ce5e304e97/mobile/config/mozconfigs/android/release - ERROR: Not Found
2012-02-08 05:48:45,731 : INFO : Missing mozconfigs to compare for linux-android
2012-02-08 05:48:52,838 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-release/raw-file/18ce5e304e97/mobile/config/mozconfigs/linux-desktop/release - ERROR: Not Found
2012-02-08 05:48:59,859 : INFO : Missing mozconfigs to compare for linux-mobile

Comment 1

[Lukas Blakk [:lsblakk] use ?needinfo]

It did work before we switched to in-tree mozconfigs

Comment 2

[Armen [:armenzg]]

I am thinking that the output error might now be the one in bug 729516 since we don't have Desktop mobile repacks.

Comment 3

[Aki Sasaki (not active)]

2012-02-22 07:05:38,577 : INFO : Comparing fennec mozconfigs to nightly mozconfigs...
2012-02-22 07:05:45,713 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-beta/raw-file/52cf2b0c8439/mobile/android/config/mozconfigs/android/release - ERROR: Not Found
2012-02-22 07:05:52,001 : INFO : Missing mozconfigs to compare for android
2012-02-22 07:05:58,219 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-beta/raw-file/52cf2b0c8439/mobile/xul/config/mozconfigs/android/release - ERROR: Not Found
2012-02-22 07:06:04,163 : INFO : Missing mozconfigs to compare for android-xul

Comment 5

[Aki Sasaki (not active)]

Attachment: mobile whitelist needed to get mozconfig errors to 0

Tested against my user repo mozilla-beta and mozilla-esr10; I'm going to rely on the beta->release merge to get m-r fixed up.

Comment 6

[Aki Sasaki (not active)]

Attachment: mozilla-beta mobile mozconfigs

* deleted mobile desktop mozconfigs
* added release and l10n mozconfigs for android, android-xul

This will merge into mozilla-release.
Coming: nightly patches for mozilla-{central,aurora}; nightly+release patch for mozilla-esr10.

I'll also have to patch mozharness to point to the new l10n mozconfig locations.

Comment 7

[Aki Sasaki (not active)]

Attachment: mobile esr10 mozconfigs

* deleted mobile desktop mozconfigs
* added release mozconfigs for linux-android
* fixed branding for bug 730918

Comment 8

[Aki Sasaki (not active)]

Attachment: mobile central mozconfigs

Noted a couple things:

* I'm not touching the debug mozconfigs. Not sure this is a big deal.
* I added l10n-{nightly,release} mozconfigs for mozilla-beta android-xul, when we're not doing android-xul single locale at all.  Not sure this is a big deal either, but I can remove em easily.

Comment 9

[Aki Sasaki (not active)]

Attachment: mobile aurora mozconfigs

Comment 10

[Aki Sasaki (not active)]

Attachment: point mozharness single locale mozconfigs at in-tree mozconfigs

Comment 11

[Chris AtLee [:catlee]]

Comment on attachment 602222 [details] [diff] [review]
mozilla-beta mobile mozconfigs

Review of attachment 602222 [details] [diff] [review]:
-----------------------------------------------------------------

looks good, assuming you want the XUL builds to use version 13 of the SDK, and native to use version 14.

Comment 12

[Chris AtLee [:catlee]]

Comment on attachment 602226 [details] [diff] [review]
mobile central mozconfigs

Review of attachment 602226 [details] [diff] [review]:
-----------------------------------------------------------------

deleting files makes me happy

Comment 13

[Chris AtLee [:catlee]]

looks like this fixes the missing l10n and release mozconfigs for mobile from bug 558180, right?

Comment 14

[Aki Sasaki (not active)]

Comment on attachment 602222 [details] [diff] [review]
mozilla-beta mobile mozconfigs

[Approval Request Comment]
This is basically a cleanup of the in-tree mozconfigs and moving mozconfigs out of buildbot-configs into the tree.

Risk to taking this patch (and alternatives if risky):
None.

String changes made by this patch:
None.

Comment 15

[Aki Sasaki (not active)]

Comment on attachment 602223 [details] [diff] [review]
mobile esr10 mozconfigs

[Approval Request Comment]
This is basically a cleanup of the in-tree mozconfigs and moving mozconfigs out of buildbot-configs into the tree.

Risk to taking this patch (and alternatives if risky):
None.

String changes made by this patch:
None.

Comment 16

[Aki Sasaki (not active)]

Comment on attachment 602227 [details] [diff] [review]
mobile aurora mozconfigs

[Approval Request Comment]
This is basically a cleanup of the in-tree mozconfigs and moving mozconfigs out of buildbot-configs into the tree.

Risk to taking this patch (and alternatives if risky):
None.

String changes made by this patch:
None.

Comment 17

[Aki Sasaki (not active)]

(In reply to Chris AtLee [:catlee] from comment #13)
> looks like this fixes the missing l10n and release mozconfigs for mobile
> from bug 558180, right?

Yes.
Doesn't deal with m-r, but the merge will fix that.

Comment 18

[Aki Sasaki (not active)]

Comment on attachment 602226 [details] [diff] [review]
mobile central mozconfigs

Pushed to inbound (as ffxbld):
http://hg.mozilla.org/integration/mozilla-inbound/rev/e29cdf5839e3

Comment 19

[Aki Sasaki (not active)]

Comment on attachment 602218 [details] [diff] [review]
mobile whitelist needed to get mozconfig errors to 0

http://hg.mozilla.org/build/tools/rev/bc68063e9bdb

Comment 20

[Lukas Blakk [:lsblakk] use ?needinfo]

Comment on attachment 602223 [details] [diff] [review]
mobile esr10 mozconfigs

Go ahead and land this, I can send the go again with a new changeset

Comment 21

[Aki Sasaki (not active)]

Comment on attachment 602223 [details] [diff] [review]
mobile esr10 mozconfigs

https://hg.mozilla.org/releases/mozilla-esr10/rev/97a378d463df

Comment 22

[Ed Morley [:emorley]]

https://hg.mozilla.org/mozilla-central/rev/e29cdf5839e3

Comment 23

[Aki Sasaki (not active)]

Reopening until we get the aurora+beta mozconfigs approved and landed with the mozharness patch.

Comment 24

[Ed Morley [:emorley]]

(For future inbound landings where the bug needs to stay open post merge to mozilla-central, you can use [leave open] in the whiteboard, to save having to reopen :-))

Comment 25

[Aki Sasaki (not active)]

Comment on attachment 602222 [details] [diff] [review]
mozilla-beta mobile mozconfigs

http://hg.mozilla.org/releases/mozilla-beta/rev/824244c92d20

Sweet, 11.0b6's release_sanity should be good.

Comment 26

[Aki Sasaki (not active)]

Comment on attachment 602227 [details] [diff] [review]
mobile aurora mozconfigs

http://hg.mozilla.org/releases/mozilla-aurora/rev/e3d75c79ac48

Comment 27

[Aki Sasaki (not active)]

Comment on attachment 602229 [details] [diff] [review]
point mozharness single locale mozconfigs at in-tree mozconfigs

http://hg.mozilla.org/build/mozharness/rev/2989bd62015a

Comment 28

[Aki Sasaki (not active)]

Crap, the aurora->beta merge wiped the release mozconfigs.

Comment 29

[[e-mail] (:bhearsum)]

I think we just need to update the whitelists, actually. I found 3 changes total (pasted from build notes):
* All desktop platforms
** --enable-signmar in nightly but not in release
*** We don't need to build signmar for releases, needs to be added to whitelist '''FIXME'''
** --enable-js-diagnostics in nightly but not in release
*** ASSUMING that we don't want to build betas with this '''FIXME'''
* Linux & Linux64
** --enable-warnings-as-errors in nightly but not in release
*** ASSUMING that we don't want to build betas with this '''FIXME'''


I'm certain we don't need signmar, and I assume we don't need the others but we should verify that with someone who knows for sure.

Comment 30

[[e-mail] (:bhearsum)]

Oh, I see. We're missing some mobile release configs altogether.

Comment 31

[Chris AtLee [:catlee]]

the release mozconfigs need to be added to mozilla-central and mozilla-aurora as well so they get uplifted the next time around.

Comment 32

[Lukas Blakk [:lsblakk] use ?needinfo]

Attachment: mozilla central release mozconfigs (for beta)

I'm leaving the beta branding in here since we don't start using the release mozconfigs until Beta builds anyway - so this way we don't really have to worry about branding or updates every time we uplift, only from beta-> release

Comment 33

[Lukas Blakk [:lsblakk] use ?needinfo]

Attachment: mozilla aurora release mozconfigs (for beta)

same as previous attachment, I'm leaving the beta branding in here since we don't start using the release mozconfigs until Beta builds anyway - so this way we don't really have to worry about branding or updates every time we uplift, only from beta-> release

Comment 34

[Aki Sasaki (not active)]

Comment on attachment 605897 [details] [diff] [review]
mozilla aurora release mozconfigs (for beta)

These guys are missing l10n-release.
I think I need to take a look here.

Comment 35

[Aki Sasaki (not active)]

Attachment: mozilla-beta mobile mozconfigs

[Approval Request Comment]
Regression caused by (bug #): 
aurora->beta merge.

User impact if declined: 
No single locale android beta builds when locales are signed off for Fennec.

Testing completed (on m-c, etc.): 
None.

Risk to taking this patch (and alternatives if risky):
Low.  If we start doing l10n on mozilla-beta, not taking this will break things.

String changes made by this patch:
None

post-merge.

This:
* changes the update channel to ${MOZ_UPDATE_CHANNEL} for less merge-time editing
* fixes l10n-nightly's branding
* adds mobile/android l10n-release

We'll have to update the merge docs.

Comment 36

[Aki Sasaki (not active)]

I'm not sure if ${MOZ_UPDATE_CHANNEL} is set for single locale repacks.
It probably isn't, but that should be easy to set for mozharness.

Comment 37

[Aki Sasaki (not active)]

Attachment: mozharness mobile_l10n MOZ_UPDATE_CHANNEL

Comment 38

[Lukas Blakk [:lsblakk] use ?needinfo]

Comment on attachment 605940 [details] [diff] [review]
mozilla-beta mobile mozconfigs

[Triage comment]
looks good, please go ahead and land so respin on 12.0b1 can pick these up.

Comment 39

[Aki Sasaki (not active)]

Comment on attachment 605940 [details] [diff] [review]
mozilla-beta mobile mozconfigs

http://hg.mozilla.org/releases/mozilla-beta/rev/e62ff9155be8

Comment 40

[Aki Sasaki (not active)]

Attachment: mozilla-aurora release mozconfigs

This patch:

* fixes the android l10n-nightly l10n-base and branding.
* switches the update channel to ${MOZ_UPDATE_CHANNEL} for less editing at merge time
* adds the release mozconfigs like attachment 605897 [details] [diff] [review], but with ${MOZ_UPDATE_CHANNEL}
* adds l10n-release for mobile/android with beta branding.

We'll need to update the merge docs for this as well.

[Approval Request Comment]
Regression caused by (bug #): 
central -> aurora merge.

User impact if declined: 


Testing completed (on m-c, etc.): 
None.

Risk to taking this patch (and alternatives if risky):
Low.  

String changes made by this patch:
None

Comment 41

[Aki Sasaki (not active)]

Oh, User impact if declined: breakage of android single locale repacks until l10n-base is fixed in l10n-nightly.

Comment 42

[Aki Sasaki (not active)]

Attachment: mozilla-central mobile mozconfigs

This patch:
* sets the l10n-nightly update channel to ${MOZ_UPDATE_CHANNEL}
* adds the release mozconfigs with beta branding as does attachment 605896 [details] [diff] [review], but with ${MOZ_UPDATE_CHANNEL}
* adds the l10n-release mobile/android mozconfig with beta branding

Are the merge docs still the same ones on github?

Comment 43

[Aki Sasaki (not active)]

[15:26]	<aki|buildduty>	i think in http://mozilla.github.com/process-releases/draft/development_specifics/ i want to add a sed -i -e 's,branding/nightly,branding/aurora,' mobile/*/config/mozconfigs/android/*
[15:27]	<aki|buildduty>	also sed -i -e 's,with-l10n-base=.*,with-l10n-base=..,' mobile/android/config/mozconfigs/android/l10n-nightly

Comment 44

[Aki Sasaki (not active)]

Updated https://wiki.mozilla.org/Release_Management/Merge_Documentation , which doesn't seem to have mozilla-beta -> mozilla-release info.  Should help keep the l10n-nightly's up to date though.

Comment 45

[Lukas Blakk [:lsblakk] use ?needinfo]

Comment on attachment 605953 [details] [diff] [review]
mozilla-aurora release mozconfigs

[Triage comment]
awesome.  glad we won't clobber on merge anymore.

Comment 46

[Aki Sasaki (not active)]

Comment on attachment 605953 [details] [diff] [review]
mozilla-aurora release mozconfigs

https://hg.mozilla.org/releases/mozilla-aurora/rev/dff8faf7de73

Comment 47

[Aki Sasaki (not active)]

Comment on attachment 605947 [details] [diff] [review]
mozharness mobile_l10n MOZ_UPDATE_CHANNEL

http://hg.mozilla.org/build/mozharness/rev/b02ac449511e

Comment 48

[Aki Sasaki (not active)]

Comment on attachment 605981 [details] [diff] [review]
mozilla-central mobile mozconfigs

https://hg.mozilla.org/integration/mozilla-inbound/rev/011bce915a20

This bug should be resolvable when this migrates to m-c.

Comment 49

[Marco Bonardo [:mak]]

https://hg.mozilla.org/mozilla-central/rev/011bce915a20