1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=67707520&repo=mozilla-central

https://archive.mozilla.org/pub/mobile/tinderbox-builds/mozilla-central-l10n/mozilla-central-android-api-15-l10n_5-unknown-bm71-build1-build0.txt.gz

Tomorrow we find out whether the summary needs to have "on nightlies triggered through self-serve" added to it or not.

Comment 1

[Justin Wood (:Callek)]

Attachment: Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

Review commit: https://reviewboard.mozilla.org/r/103896/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/103896/

Comment 2

[Michael Shal [:mshal]]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

https://reviewboard.mozilla.org/r/103896/#review104566

Overall this looks good to me. Just one question that you may already have an answer to.

::: testing/mozharness/scripts/mobile_l10n.py:371
(Diff revision 1)
>              replace_dict['user_repo_override'] = c['user_repo_override']
> -            # deepcopy() needed because of self.config lock bug :(
> -            for repo_dict in deepcopy(c['repos']):
> -                repo_dict['repo'] = repo_dict['repo'] % replace_dict
> -                repos.append(repo_dict)
> -        else:
> +        # this is OK so early because we get it from buildbot, or
> +        # the command line for local dev
> +        replace_dict['revision'] = self._query_revision()
> +
> +        for repository in c['repos']:

Are you sure you no longer need the deepcopy in c['repos'] here? I'm not sure what the self.config lock bug refers to in the previous comment, but I don't see how this patch would otherwise work around it.

Comment 3

[Justin Wood (:Callek)]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

https://reviewboard.mozilla.org/r/103896/#review104566

> Are you sure you no longer need the deepcopy in c['repos'] here? I'm not sure what the self.config lock bug refers to in the previous comment, but I don't see how this patch would otherwise work around it.

Yes, (a) This is the code used in desktop_l10n.py which doesn't use deepcopy. (b) This is setting new dicts with direct value replacement, rather than trying to modify in place, like was happening before.

Comment 4

[Justin Wood (:Callek)]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/103896/diff/1-2/

Comment 5

[Justin Wood (:Callek)]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

Please, re-review this (first patch was incomplete due to accidentally not hitting "Save" first.

Comment 6

[Michael Shal [:mshal]]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

https://reviewboard.mozilla.org/r/103896/#review104674

::: testing/mozharness/scripts/mobile_l10n.py:252
(Diff revisions 1 - 2)
>              m = r.match(line)
>              if m:
>                  self.buildid = m.groups()[0]
>          return self.buildid
>  
>      def query_revision(self):

Since this code is now basically identicaly with desktop_l10n.py, please file a followup to share the two query_revision functions. No need to block on fixing this now, though.

Comment 7

[Justin Wood (:Callek)]

Comment on attachment 8825816 [details]
Bug 1330191 - Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long.

https://reviewboard.mozilla.org/r/103896/#review104674

> Since this code is now basically identicaly with desktop_l10n.py, please file a followup to share the two query_revision functions. No need to block on fixing this now, though.

I'll be gutting much of this code, and unifying it as part of my overall plan, so I won't file the bug specifically for this comment but I can assure that it will happen.

Comment 8

[Justin Wood (:Callek)]

https://hg.mozilla.org/projects/date/rev/472d7c6ccafd34fef8d8c0f25bfdd3dbfe352a60

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0761d9bf56c4
Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long. r=mshal

Comment 10

[Justin Wood (:Callek)]

(In reply to Pulsebot from comment #9)
> Pushed by [e-mail]:
> https://hg.mozilla.org/integration/autoland/rev/0761d9bf56c4
> Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment
> 12-40 characters long. r=mshal

Wes promised he'd make this patch land before his EOD, (either by graft or merge), so its in tomorrow's nightly.

n-i to him to ensure that.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/13603af3862d
Android l10n nightlies fail with abort: --revision must be a SHA-1 fragment 12-40 characters long. r=mshal a=merge

Comment 12

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/13603af3862d9583ed2feefb06e0988c2d7fed8c

Grafted this manually from autoland because I didn't get a merge in today. There'll likely be another comment when the merge officially gets the original landing over to mozilla-central.

Comment 13

[Carsten Book [:Tomcat]]

i guess this cause https://treeherder.mozilla.org/logviewer.html#?job_id=68381306&repo=mozilla-central now

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/1289b60bd5ed
Bustage fix from Bug 1330191. r=me, a=Tomcat

Comment 15

[Justin Wood (:Callek)]

Sorry for that...

https://hg.mozilla.org/mozilla-central/rev/1289b60bd5ed221f6713497fcdc8167ae3896916

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/6e5f04db4c4a
Another Bustage fix from Bug 1330191. r=me, a=philor

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/d8a68016cc26
Bustage fix from Bug 1330191. r=me, a=Tomcat

Comment 18

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/d8a68016cc26

Comment 19

[Intermittent Failures Robot]

24 failures in 722 pushes (0.033 failures/push) were associated with this bug in the last 7 days.  

Repository breakdown:
* mozilla-central: 24

Platform breakdown:
* android-4-0-armv7-api15: 24

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1330191&startday=2017-01-09&endday=2017-01-15&tree=all