1336654 - Permafailing dom/security/test/contentverifier/browser_verify_content_about_newtab.js | Valid remote newtab page must have built-in CSP. - Got {}, expected {"csp-policies":[{"report-only":false,"script-src":["https://example.com","'unsafe-inline'"]

Status: RESOLVED FIXED

(Core :: DOM: Security, defect)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=74451524&repo=autoland

https://queue.taskcluster.net/v1/task/IZ4hTl6GQfuCiszvI-s7wQ/runs/0/artifacts/public/logs/live_backing.log

This just started failing out of the blue today on both inbound and autoland. Retriggers of previously-passing runs are all failing.

Comment 1

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/7aa5e444af0f
Skip the suddenly permafailing tests to reopen the tree a=me CLOSED TREE

Comment 2

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Keeler, you've recently(ish) reviewed changes to this test. Any ideas?

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

goodChain.pem expired yesterday:

        Validity
            Not Before: Nov 27 00:00:00 2014 GMT
            Not After : Feb  4 00:00:00 2017 GMT

https://dxr.mozilla.org/mozilla-central/rev/1d025ac534a6333a8170a59a95a8a3673d4028ee/dom/security/test/contentverifier/goodChain.pem

For this reason, all tress with this test should be affected.

Comment 4

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/releases/mozilla-aurora/rev/5187252151ea

Comment 5

[Intermittent Failures Robot]

137 failures in 36 pushes (3.806 failures/push) were associated with this bug yesterday.  

Repository breakdown:
* autoland: 97
* mozilla-inbound: 21
* try: 19

Platform breakdown:
* linux64: 112
* windows7-32-vm: 9
* windows8-64: 6
* osx-10-10: 6
* linux32: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1336654&startday=2017-02-04&endday=2017-02-04&tree=all

Comment 6

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/releases/mozilla-beta/rev/e5373fbb022e1a227116a989d22929040bfabc3c
https://hg.mozilla.org/releases/mozilla-release/rev/142c26e6e6e46b64653bf84db27ad1ed85d6dfc8

Comment 7

[Intermittent Failures Robot]

166 failures in 733 pushes (0.226 failures/push) were associated with this bug in the last 7 days. 

This is the #1 most frequent failure this week. 

** This failure happened more than 50 times this week! Resolving this bug is a high priority. **

Repository breakdown:
* autoland: 112
* mozilla-inbound: 35
* try: 19

Platform breakdown:
* linux64: 130
* windows7-32-vm: 10
* linux32: 10
* osx-10-10: 9
* windows8-64: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1336654&startday=2017-01-30&endday=2017-02-05&tree=all

Comment 8

[Franziskus Kiefer [:franziskus]]

Attachment: fix-cs-tests.patch

This is related to bug 1332131 that replaced expiring certificates. But this one needs some manual work. (Sorry for this patch here but MozReview isn't working for me atm...)

Comment 9

[Mark Goodwin [:mgoodwin]]

Comment on attachment 8833908 [details] [diff] [review]
fix-cs-tests.patch

LGTM

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/507fcddedb1f
update expired certs and signatures for content signature tests, r=mgoodwin

Comment 11

[Intermittent Failures Robot]

36 failures in 117 pushes (0.308 failures/push) were associated with this bug yesterday.  

Repository breakdown:
* try: 36

Platform breakdown:
* linux64: 12
* windows7-32-vm: 8
* osx-10-10: 8
* linux32: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1336654&startday=2017-02-06&endday=2017-02-06&tree=all

Comment 12

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/507fcddedb1f

Comment 13

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-release/rev/34b53a3ed396

Comment 14

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/cbe7e2f489d3

Comment 15

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/8ba4f117d820

Comment 16

[Intermittent Failures Robot]

44 failures in 836 pushes (0.053 failures/push) were associated with this bug in the last 7 days. 

This is the #45 most frequent failure this week. 

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:
* try: 44

Platform breakdown:
* linux64: 16
* linux32: 12
* windows7-32-vm: 8
* osx-10-10: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1336654&startday=2017-02-06&endday=2017-02-12&tree=all

Comment 17

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-esr52/rev/cbe7e2f489d3