1581884 - Intermittent browser/base/content/test/general/browser_blockHPKP.js | Got a pinning error page - false == true -

Status: RESOLVED WORKSFORME

(Firefox :: Security, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=267059611&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/BxEtFW_BSDeIpeRVLeq5CQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-09-17T15:04:11.733Z] 15:04:11 INFO - TEST-START | browser/base/content/test/general/browser_blockHPKP.js
[task 2019-09-17T15:04:12.469Z] 15:04:12 INFO - TEST-INFO | started process screentopng
[task 2019-09-17T15:04:13.067Z] 15:04:13 INFO - TEST-INFO | screentopng: exit 0
[task 2019-09-17T15:04:13.068Z] 15:04:13 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/general/browser_blockHPKP.js | Got a pinning error page - false == true -
[task 2019-09-17T15:04:13.069Z] 15:04:13 INFO - Stack trace:
[task 2019-09-17T15:04:13.070Z] 15:04:13 INFO - resource://testing-common/content-task.js line 62 > eval:null:6
[task 2019-09-17T15:04:13.071Z] 15:04:13 INFO - resource://testing-common/content-task.js:null:63
[task 2019-09-17T15:04:13.124Z] 15:04:13 INFO - TEST-PASS | browser/base/content/test/general/browser_blockHPKP.js | load complete -

Comment 1

[Dorel Luca [:dluca]]

Looks like this bug started when Bug 1561443 landed here:
https://hg.mozilla.org/integration/autoland/rev/0cf57171638ca879f73cc902e508166d641db2a3

prathiksha: Can you please take a look at this bug?

Comment 2

[:prathiksha]

(In reply to Dorel Luca [:dluca] from comment #1)

prathiksha: Can you please take a look at this bug?

Taking a look at this now

Comment 3

[:prathiksha]

Attachment: Bug 1581884 - Fix intermittent failure browser/base/content/test/general/browser_blockHPKP.js. r?johannh

Comment 4

[Intermittent Failures Robot]

17 failures in 836 pushes (0.02 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 3
• mozilla-inbound: 2

Platform breakdown:

• linux64: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-18&endday=2019-09-18&tree=all

Comment 5

[Intermittent Failures Robot]

18 failures in 869 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 4
• mozilla-inbound: 3
• try: 3

Platform breakdown:

• linux64: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-20&endday=2019-09-20&tree=all

Comment 6

[Intermittent Failures Robot]

75 failures in 4350 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #11 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 20
• mozilla-inbound: 6
• try: 5

Platform breakdown:

• linux64: 75

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 7

[Intermittent Failures Robot]

15 failures in 684 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 3
• try: 1
• mozilla-inbound: 1

Platform breakdown:

• linux64: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-23&endday=2019-09-23&tree=all

Comment 8

[Andreea Pavel [:apavel]]

There are 66 total failures in the last 7 days.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=268395052&repo=mozilla-central&lineNumber=1932

[task 2019-09-25T16:57:15.588Z] 16:57:15 INFO - TEST-START | browser/base/content/test/general/browser_blockHPKP.js
[task 2019-09-25T16:57:16.199Z] 16:57:16 INFO - TEST-INFO | started process screentopng
[task 2019-09-25T16:57:16.802Z] 16:57:16 INFO - TEST-INFO | screentopng: exit 0
[task 2019-09-25T16:57:16.802Z] 16:57:16 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/general/browser_blockHPKP.js | Got a pinning error page - false == true -
[task 2019-09-25T16:57:16.803Z] 16:57:16 INFO - Stack trace:
[task 2019-09-25T16:57:16.803Z] 16:57:16 INFO - resource://testing-common/content-task.js line 62 > eval:null:6
[task 2019-09-25T16:57:16.803Z] 16:57:16 INFO - resource://testing-common/content-task.js:null:63
[task 2019-09-25T16:57:16.804Z] 16:57:16 INFO - TEST-PASS | browser/base/content/test/general/browser_blockHPKP.js | load complete -
[task 2019-09-25T16:57:16.805Z] 16:57:16 INFO - GECKO(1705) | MEMORY STAT | vsize 3022MB | residentFast 370MB | heapAllocated 159MB
[task 2019-09-25T16:57:16.805Z] 16:57:16 INFO - TEST-OK | browser/base/content/test/general/browser_blockHPKP.js | took 928ms

Prathiksha are there any updates here?

Comment 9

[Intermittent Failures Robot]

26 failures in 850 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 25
• mozilla-central: 1

Platform breakdown:

• linux64: 18
• windows10-64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-27&endday=2019-09-27&tree=all

Comment 10

[Intermittent Failures Robot]

67 failures in 4530 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #18 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 53
• mozilla-central: 8
• try: 5
• mozilla-inbound: 1

Platform breakdown:

• linux64: 55
• linux64-shippable: 1
• windows10-64: 10
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 11

[Intermittent Failures Robot]

38 failures in 820 pushes (0.046 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 32
• mozilla-central: 5
• try: 1

Platform breakdown:

• linux64: 27
• windows10-64: 9
• windows7-32: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-30&endday=2019-09-30&tree=all

Comment 12

[Intermittent Failures Robot]

30 failures in 770 pushes (0.039 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 1
• autoland: 20
• mozilla-central: 5
• try: 4

Platform breakdown:

• linux64: 20
• windows10-64: 8
• macosx1014-64: 1
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-01&endday=2019-10-01&tree=all

Comment 13

[Dorel Luca [:dluca]]

Hi, any news on this patch?

Comment 14

[Intermittent Failures Robot]

64 failures in 930 pushes (0.069 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 52
• mozilla-central: 4
• try: 7
• mozilla-inbound: 1

Platform breakdown:

• linux64: 36
• windows10-64: 25
• windows10-64-qr: 1
• linux64-ccov: 1
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-02&endday=2019-10-02&tree=all

Comment 15

[Andreea Pavel [:apavel]]

Attachment: Bug 1581884 - disabled browser_blockHPKP.js on linux64 and win64 asan r=johannh

Comment 16

[Intermittent Failures Robot]

28 failures in 824 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 4
• try: 1

Platform breakdown:

• linux64: 17
• linux64-shippable: 2
• linux64-ccov: 1
• macosx1014-64: 1
• windows10-64: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-03&endday=2019-10-03&tree=all

Comment 17

[Intermittent Failures Robot]

29 failures in 619 pushes (0.047 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 2
• try: 4

Platform breakdown:

• linux64: 19
• windows7-32: 2
• windows10-64: 7
• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-04&endday=2019-10-04&tree=all

Comment 18

[Intermittent Failures Robot]

23 failures in 196 pushes (0.117 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• try: 5
• mozilla-central: 8

Platform breakdown:

• linux64: 18
• windows7-32: 1
• windows10-64-ccov: 1
• windows10-64: 2
• linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-05&endday=2019-10-05&tree=all

Comment 19

[Intermittent Failures Robot]

227 failures in 4292 pushes (0.053 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 166
• mozilla-central: 33
• try: 26
• mozilla-inbound: 2

Platform breakdown:

• linux64: 147
• windows10-64: 62
• windows7-32: 4
• macosx1014-64-shippable: 1
• macosx1014-64: 3
• windows10-64-qr: 2
• linux64-ccov: 2
• linux64-shippable: 3
• windows10-64-ccov: 1
• linux64-devedition: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 20

[Intermittent Failures Robot]

53 failures in 677 pushes (0.078 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 41
• mozilla-central: 7
• mozilla-inbound: 1
• try: 4

Platform breakdown:

• linux64: 31
• macosx1014-64: 2
• windows10-64: 18
• linux64-shippable: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-07&endday=2019-10-07&tree=all

Comment 21

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4e0dd8b16ae0
disabled browser_blockHPKP.js on linux64 and win64 asan r=johannh

Comment 22

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/4e0dd8b16ae0

Comment 23

[Johann Hofmann [:johannh]]

Was disabled for now, let's see if Prathiksha has time to pick this up again eventually :)

Comment 24

[Intermittent Failures Robot]

17 failures in 785 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 4
• try: 4
• mozilla-inbound: 1

Platform breakdown:

• linux64: 11
• macosx1014-64: 2
• windows10-64: 3
• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-08&endday=2019-10-08&tree=all

Comment 25

[Intermittent Failures Robot]

86 failures in 3801 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 60
• mozilla-central: 12
• mozilla-inbound: 3
• try: 11

Platform breakdown:

• linux64: 43
• macosx1014-64: 11
• windows10-64: 24
• linux64-shippable: 1
• windows7-32: 2
• windows10-aarch64: 1
• windows10-64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-07&endday=2019-10-13&tree=all

Comment 26

[Intermittent Failures Robot]

20 failures in 3964 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• try: 3
• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 6
• macosx1014-64: 12
• windows7-32: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 27

[Intermittent Failures Robot]

29 failures in 4182 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 7
• autoland: 18
• mozilla-central: 4

Platform breakdown:

• linux64: 2
• macosx1014-64: 8
• windows10-64: 5
• macosx1014-64-shippable: 2
• windows7-32: 2
• windows7-32-shippable: 4
• windows10-64-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-21&endday=2019-10-27&tree=all

Comment 28

[Andreea Pavel [:apavel]]

Hi Johann, based on recent failures https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-10-21&endday=2019-10-28&tree=trunk&bug=1581884 can we update the patch to include all windows and mac?

Comment 29

[Intermittent Failures Robot]

46 failures in 4314 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-beta: 9
• autoland: 29
• mozilla-central: 4
• try: 4

Platform breakdown:

• windows10-64: 5
• windows7-32-shippable: 11
• windows10-64-ccov: 1
• macosx1014-64: 16
• windows10-64-qr: 6
• windows7-32: 6
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 30

[Andreea Pavel [:apavel]]

Hi Geoff, since Johann hasn't replied, can you please take a look and answer the above?

Comment 31

[Geoff Brown [:gbrown]]

Yes, I think we need to update to include all windows and mac (skip-if = true may be appropriate now).

Comment 32

[Andreea Pavel [:apavel]]

Attachment: Bug 1581884 - disable browser_blockHPKP.js on all platforms r=gbrown

Comment 33

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/271bbaa11d21
disable browser_blockHPKP.js on all platforms r=gbrown

Comment 34

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/271bbaa11d21

Comment 35

[Intermittent Failures Robot]

27 failures in 4850 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 20
• mozilla-central: 2
• mozilla-beta: 3
• try: 2

Platform breakdown:

• macosx1014-64: 10
• windows7-32: 11
• windows10-64-qr: 5
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-11-04&endday=2019-11-10&tree=all

Comment 36

[Intermittent Failures Robot]

5 failures in 4207 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 5

Platform breakdown:

• windows7-32: 3
• macosx1014-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-11-11&endday=2019-11-17&tree=all

Comment 37

[Intermittent Failures Robot]

5 failures in 5444 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 5

Platform breakdown:

• macosx1014-64-devedition: 1
• macosx1014-64: 2
• linux64-shippable: 1
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-11-18&endday=2019-11-24&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 4331 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-11-25&endday=2019-12-01&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 5144 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581884&startday=2019-12-02&endday=2019-12-08&tree=all

Comment 40

[Dana Keeler (she/her) (use needinfo) [:keeler]]

This was removed in bug 1630038.