1206120 - Test Failure: test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Status: RESOLVED FIXED

(Testing :: Firefox UI Tests, defect, P1)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I assume the renewal of the SSL certs yesterday caused a regression for us.

06:01:11 Traceback (most recent call last):
06:01:11   File "/Users/mozauto/jenkins/workspace/mozilla-central_functional/venv/lib/python2.7/site-packages/marionette/marionette_test.py", line 296, in run
06:01:11     testMethod()
06:01:11   File "/Users/mozauto/jenkins/workspace/mozilla-central_functional/venv/lib/python2.7/site-packages/firefox_ui_harness/decorators.py", line 23, in wrapper
06:01:11     return target(self, *args, **kwargs)
06:01:11   File "/Users/mozauto/jenkins/workspace/mozilla-central_functional/venv/lib/python2.7/site-packages/firefox_ui_tests/functional/security/test_dv_certificate.py", line 53, in test_dv_cert
06:01:11     self.security.get_domain_from_common_name(cert['commonName']))
06:01:11 AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'
06:01:11 - ssl-dv.mozqa.com
06:01:11 + mozqa.com

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Looks to be a regression in Nightly since yesterday given that Aurora builds don't have this problem.

Pushlog:
https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=e7d613b3bcfe&tochange=11dc79e23211

Comment 2

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2227343
repository: mozilla-central
start_time: 2015-09-18T05:25:31
who: hskupin[at]gmail[dot]com
machine: mm-ub-1404-32-2.qa.scl3.mozilla.com
buildname: non-buildbot linux32 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2227602
repository: mozilla-central
start_time: 2015-09-18T05:43:40
who: hskupin[at]gmail[dot]com
machine: mm-ub-1404-64-2.qa.scl3.mozilla.com
buildname: non-buildbot linux64 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2227822
repository: mozilla-central
start_time: 2015-09-18T06:00:45
who: hskupin[at]gmail[dot]com
machine: mm-osx-109-3.qa.scl3.mozilla.com
buildname: non-buildbot osx-10-9 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228635
repository: mozilla-central
start_time: 2015-09-18T07:54:51
who: hskupin[at]gmail[dot]com
machine: mm-win-xp-32-4.qa.scl3.mozilla.com
buildname: non-buildbot windowsxp test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228624
repository: mozilla-central
start_time: 2015-09-18T07:53:39
who: hskupin[at]gmail[dot]com
machine: mm-win-7-64-2.qa.scl3.mozilla.com
buildname: non-buildbot windows7-64 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228656
repository: mozilla-central
start_time: 2015-09-18T07:59:17
who: hskupin[at]gmail[dot]com
machine: mm-win-7-64-2.qa.scl3.mozilla.com
buildname: non-buildbot windows7-64 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228627
repository: mozilla-central
start_time: 2015-09-18T07:53:44
who: hskupin[at]gmail[dot]com
machine: mm-win-7-32-2.qa.scl3.mozilla.com
buildname: non-buildbot windows7-32 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'
TEST-UNEXPECTED-ERROR | test_safe_browsing_notification.py TestSafeBrowsingNotificationBar.test_notification_bar | TimeoutException: TimeoutException: Timed out after 30.1 seconds

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228625
repository: mozilla-central
start_time: 2015-09-18T07:53:39
who: hskupin[at]gmail[dot]com
machine: mm-win-81-32-4.qa.scl3.mozilla.com
buildname: non-buildbot windows8-32 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228626
repository: mozilla-central
start_time: 2015-09-18T07:53:41
who: hskupin[at]gmail[dot]com
machine: mm-win-81-64-3.qa.scl3.mozilla.com
buildname: non-buildbot windows8-64 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 11

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2228657
repository: mozilla-central
start_time: 2015-09-18T07:59:18
who: hskupin[at]gmail[dot]com
machine: mm-win-81-64-3.qa.scl3.mozilla.com
buildname: non-buildbot windows8-64 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

TEST-UNEXPECTED-FAIL | test_dv_certificate.py TestDVCertificate.test_dv_cert | AssertionError: u'ssl-dv.mozqa.com' != u'mozqa.com'

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2227824
repository: mozilla-central
start_time: 2015-09-18T06:55:57
who: hskupin[at]gmail[dot]com
machine: mm-osx-1010-3.qa.scl3.mozilla.com
buildname: non-buildbot osx-10-10 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

Comment 13

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=2227825
repository: mozilla-central
start_time: 2015-09-18T06:51:40
who: hskupin[at]gmail[dot]com
machine: mm-osx-106-3.qa.scl3.mozilla.com
buildname: non-buildbot osx-10-6 test Firefox UI Test - functional (en-US)
revision: 11dc79e23211

Comment 14

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Regression from bug 1204616, which is now showing the full domain name inclusive subdomains in the control center. Fix will be easy.

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: github_pull_request.txt

Simple fix given that we do longer have to strip off the subdomain name.

Comment 16

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Merged PR to master as:
https://github.com/mozilla/firefox-ui-tests/commit/d12d4796b3609106081cd22696b500763d02d02d