1523750 - Linux and Windows opt (=pgo) builds busted when Gecko 67 merges to beta on 2019-03-11

Status: VERIFIED FIXED

(WebExtensions :: General, defect, P1, blocker)

Description

[Sebastian Hengst [:aryx] (needinfo on intermittent or backout)]

Today's central-as-early-beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=d0f4c99d5e185c2d064b033bf940687d70d1a9b2&selectedJob=224709639

Linux and Windows builds are busted (the Windows "B" ran out of time, ignore those).

Comparison of the log of failed valgrind task with a passing one from yesterday shows this line is new:

[task 2019-01-29T13:57:00.995Z] 13:57:00 INFO - 1:01.30 1548770220967 addons.xpi-utils WARN Add-on [e-mail] is not correctly signed.

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=224709689&repo=try

The version number got increased from 66 to 67 yesterday, this can have triggered it. Bug 1512436 also landed. Andrew, can you check if this is from the latter? Thank you in advance.

Comment 1

[Andrew Swan [:aswan]]

I think this was probably bug 1514594

Comment 2

[Sebastian Hengst [:aryx] (needinfo on intermittent or backout)]

Bisection shows it's from bug 1514954 / bug 1519596. The [e-mail] got patched at https://hg.mozilla.org/mozilla-central/rev/6b56696d713a#l2820.1

Downloading that file and an attempt to install it lets Firefox claim that the file is corrupt. See bug 1451463 for signing.

Comment 3

[Intermittent Failures Robot]

2 failures in 2628 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2

Platform breakdown:

• linux32: 1
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523750&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 4

[Cosmin Sabou [:CosminS]]

Hi! This is still happening on beta-sims: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=busted%2Cusercancel%2Crunnable&revision=8ca43f2688b208aadf65463d7097dd090966dc22&selectedJob=227490148
David, could you please redirect this to someone who can take a look at this issue? It's been 12 days since the needinfo on Kris and still no progress here. Thank you.

Comment 5

[Intermittent Failures Robot]

13 failures in 2658 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 13

Platform breakdown:

• linux32: 4
• linux64: 5
• windows2012-64: 2
• windows2012-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523750&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 6

[Intermittent Failures Robot]

9 failures in 2832 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 9

Platform breakdown:

• linux32: 3
• windows2012-64: 1
• windows2012-32: 1
• linux64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523750&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 7

[Intermittent Failures Robot]

11 failures in 2602 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 11

Platform breakdown:

• windows2012-64: 4
• linux64: 3
• windows2012-32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1523750&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 8

[Kris Maglione [:kmag]]

https://hg.mozilla.org/integration/mozilla-inbound/rev/798297c168c5aa3ef85e228268cc98c9fd088dab
Bug 1523750: Re-sign quitter extension for use in release builds. r=me

Comment 9

[Raul Gurzau (:RaulGurzau)]

https://hg.mozilla.org/mozilla-central/rev/798297c168c5

Comment 10

[Sebastian Hengst [:aryx] (needinfo on intermittent or backout)]

Verified fixed with latest beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=d696592f565abb5545d14667ff252a95a4c23590