1556172 - Intermittent browser/base/content/test/about/browser_aboutCertError.js | Correct error message found - Got , expected SEC_ERROR_EXPIRED_CERTIFICATE

Status: RESOLVED INCOMPLETE

(Firefox :: Security, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: shindli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=249565055&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/N6e_9zS3TMOWUyjUNenhKw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-06-01T14:43:30.754Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | there are two shistory entries -
[task 2019-06-01T14:43:30.754Z] 14:43:30 INFO - Clicking the go back button on about:certerror
[task 2019-06-01T14:43:30.755Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | !webNavigation.canGoBack -
[task 2019-06-01T14:43:30.762Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | webNavigation.canGoForward -
[task 2019-06-01T14:43:30.763Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Went back -
[task 2019-06-01T14:43:30.765Z] 14:43:30 INFO - Leaving test bound checkReturnToPreviousPage
[task 2019-06-01T14:43:30.765Z] 14:43:30 INFO - Entering test bound checkAppBuildIDIsDate
[task 2019-06-01T14:43:30.766Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | appBuildID contains a valid year -
[task 2019-06-01T14:43:30.766Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | appBuildID contains a valid month -
[task 2019-06-01T14:43:30.768Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | appBuildID contains a valid day -
[task 2019-06-01T14:43:30.768Z] 14:43:30 INFO - Leaving test bound checkAppBuildIDIsDate
[task 2019-06-01T14:43:30.768Z] 14:43:30 INFO - Entering test bound checkAdvancedDetails
[task 2019-06-01T14:43:30.768Z] 14:43:30 INFO - Loading a bad cert page and verifying the main error and advanced details section
[task 2019-06-01T14:43:30.770Z] 14:43:30 INFO - Buffered messages logged at 14:43:30
[task 2019-06-01T14:43:30.771Z] 14:43:30 INFO - Loading and waiting for the cert error
[task 2019-06-01T14:43:30.771Z] 14:43:30 INFO - Main error text: Nightly detected an issue and did not continue to expired.example.com. The website is either misconfigured or your computer clock is set to the wrong time.
[task 2019-06-01T14:43:30.771Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Should list hostname in error message. - true == true -
[task 2019-06-01T14:43:30.771Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Exception button is not disabled by default. - true == true -
[task 2019-06-01T14:43:30.771Z] 14:43:30 INFO - Buffered messages finished
[task 2019-06-01T14:43:30.772Z] 14:43:30 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/about/browser_aboutCertError.js | Correct error message found - Got , expected SEC_ERROR_EXPIRED_CERTIFICATE
[task 2019-06-01T14:43:30.773Z] 14:43:30 INFO - Stack trace:
[task 2019-06-01T14:43:30.774Z] 14:43:30 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
[task 2019-06-01T14:43:30.777Z] 14:43:30 INFO - chrome://mochitests/content/browser/browser/base/content/test/about/browser_aboutCertError.js:checkAdvancedDetails:137
[task 2019-06-01T14:43:30.779Z] 14:43:30 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
[task 2019-06-01T14:43:30.780Z] 14:43:30 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
[task 2019-06-01T14:43:30.781Z] 14:43:30 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1005
[task 2019-06-01T14:43:30.782Z] 14:43:30 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-06-01T14:43:30.783Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Error message is a link -
[task 2019-06-01T14:43:30.785Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Debug information is visible -
[task 2019-06-01T14:43:30.786Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Correct URL found -
[task 2019-06-01T14:43:30.788Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Correct error message found -
[task 2019-06-01T14:43:30.790Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Correct HSTS value found -
[task 2019-06-01T14:43:30.791Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Correct HPKP value found -
[task 2019-06-01T14:43:30.795Z] 14:43:30 INFO - TEST-PASS | browser/base/content/test/about/browser_aboutCertError.js | Found certificate chain -
[task 2019-06-01T14:43:30.796Z] 14:43:30 INFO - Loading cert error page in an iframe

Comment 1

[Intermittent Failures Robot]

9 failures in 4337 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 3
• mozilla-inbound: 3

Platform breakdown:

• linux64-shippable: 1
• macosx1010-64-shippable: 1
• linux64: 5
• macosx1010-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 2

[Intermittent Failures Robot]

15 failures in 810 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-central: 1
• mozilla-inbound: 3
• try: 2

Platform breakdown:

• macosx1010-64: 4
• linux64: 8
• linux64-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-03&endday=2019-06-03&tree=all

Comment 3

[Bogdan Tara[:bogdan_tara | bogdant]]

Started some r/b on range: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=linux%2Cx64%2Cshippable%2Copt%2Cmochitests%2Ctest-linux64-shippable%2Fopt-mochitest-browser-chrome-e10s-4%2Cm%28bc4%29&tochange=59a62f52fe32e6f636a662f2af445aa3f4e9de01&fromchange=fe12bde5e16bd1e0cfd0dd2edcc998c6edc6f557&selectedJob=249930603

Comment 4

[Intermittent Failures Robot]

16 failures in 1101 pushes (0.015 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 1
• try: 3
• autoland: 10
• mozilla-central: 2

Platform breakdown:

• linux64: 12
• linux64-shippable: 3
• macosx1010-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-06&endday=2019-06-06&tree=all

Comment 5

[Intermittent Failures Robot]

75 failures in 5197 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #18 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 45
• mozilla-inbound: 10
• mozilla-central: 11
• try: 9

Platform breakdown:

• macosx1010-64: 9
• linux64: 46
• linux64-shippable: 18
• linux64-ccov: 1
• linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 6

[Bogdan Tara[:bogdan_tara | bogdant]]

In the last 7 days there have been 62 occurrences on OS X 64, Linux 64, build types asan, debug and opt.

Comment 7

[Intermittent Failures Robot]

17 failures in 973 pushes (0.017 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 6
• try: 1

Platform breakdown:

• linux64: 7
• linux64-shippable: 8
• macosx1010-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-12&endday=2019-06-12&tree=all

Comment 8

[Intermittent Failures Robot]

81 failures in 4753 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #19 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• try: 11
• autoland: 46
• mozilla-inbound: 8
• mozilla-central: 16

Platform breakdown:

• linux64-devedition: 1
• linux64-shippable: 22
• linux64: 53
• macosx1010-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 9

[Alexandru Michis [:malexandru]]

Hello Justin,
this bug has gone into the disable recommended list now, is there anything you can do to fix this or should we make a disable for it?

Comment 10

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1556172 - Disable browser_aboutCertError.js on mac and linux64 cause of frequent failures. r=jmaher

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/81305a2f674e
Disable browser_aboutCertError.js on mac and linux64 cause of frequent failures. r=jmaher

Comment 12

[Johann Hofmann [:johannh]]

Prathiksha, can you take a look at this whenever you have some time on your hands? I suspect this could be caused by your refactorings and I would like to rule out a real world issue.

Thanks :)

Comment 13

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/81305a2f674e

Comment 14

[:prathiksha]

(In reply to Johann Hofmann [:johannh] from comment #12)

Prathiksha, can you take a look at this whenever you have some time on your hands? I suspect this could be caused by your refactorings and I would like to rule out a real world issue.

Thanks :)

Yeah, taking a look now. I suspect it's just a timing issue with fluent setting the placeable value.

Comment 15

[:prathiksha]

Attachment: Bug 1556172 - Fix browser_aboutCertError.js from intermittently failing. r?johannh

Comment 16

[:prathiksha]

Attachment: Bug 1556172 - Enable browser_aboutCertError.js on mac and linux64. r?johannh

Depends on D35498

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c35c9ca4d348
Fix browser_aboutCertError.js from intermittently failing. r=johannh
https://hg.mozilla.org/integration/autoland/rev/0e4343f55c7c
Enable browser_aboutCertError.js on mac and linux64. r=johannh

Comment 18

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/c35c9ca4d348
https://hg.mozilla.org/mozilla-central/rev/0e4343f55c7c

Comment 19

[Intermittent Failures Robot]

6 failures in 2581 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2
• try: 2

Platform breakdown:

• macosx1010-64: 1
• linux64: 2
• linux64-shippable: 1
• macosx1010-64-shippable: 1
• linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1556172&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 20

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup