1220614 - Various security tests are failing with: "NoSuchElementException: Unable to locate element: getMeOutOfHereButton"

Status: RESOLVED FIXED

(Testing :: Firefox UI Tests, defect, P1)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Since the Nightly build of Firefox from Saturday various of our security tests are failing with the traceback below.

Affected tests:
* test_security_notification.py TestSecurityNotification.test_invalid_cert
* test_unknown_issuer.py TestUnknownIssuer.test_unknown_issuer
* test_untrusted_connection_error_page.py TestUntrustedConnectionErrorPage.test_untrusted_connection_error_page


Traceback (most recent call last):
File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 313, in run
testMethod()
File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/lib/python2.7/site-packages/firefox_ui_tests/functional/security/test_security_notification.py", line 42, in test_invalid_cert
self.assertIsNotNone(self.marionette.find_element(By.ID, 'getMeOutOfHereButton'))
File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line 1726, in find_element
return self._send_message("findElement", body, key="value")
File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/local/lib/python2.7/site-packages/marionette_driver/decorators.py", line 36, in _
return func(*args, **kwargs)
File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line 713, in _send_message
    self._handle_error(err)
  File "/home/mozauto/jenkins/workspace/mozilla-central_functional/venv/local/lib/python2.7/site-packages/marionette_driver/marionette.py", line 774, in _handle_error
    raise errors.lookup(error)(message, stacktrace=stacktrace)
NoSuchElementException: NoSuchElementException: Unable to locate element: getMeOutOfHereButton

Reason for that is that with bug 1207107 we got rid of this button. We should update those tests to the latest state.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: Github PR

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Merged PR to mozilla-central as:
https://github.com/mozilla/firefox-ui-tests/commit/8a28435487e2191f4b517464a8585677da994ac9

I also went ahead and cherry-picked it for mozilla-aurora due to the massive failures on that branch too:
https://github.com/mozilla/firefox-ui-tests/commit/9288ee5823142d69acb25d8091aac26529142e01

Comment 3

[Intermittent Failures Robot]

58 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-aurora: 47
* mozilla-central: 11

Platform breakdown:
* windows8-64: 8
* windows7-64: 8
* osx-10-9: 5
* osx-10-6: 5
* osx-10-11: 5
* osx-10-10: 5
* linux64: 5
* linux32: 5
* windowsxp: 4
* windows8-32: 4
* windows7-32: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1220614&startday=2015-11-02&endday=2015-11-02&tree=all

Comment 4

[Intermittent Failures Robot]

58 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-aurora: 47
* mozilla-central: 11

Platform breakdown:
* windows8-64: 8
* windows7-64: 8
* osx-10-9: 5
* osx-10-6: 5
* osx-10-11: 5
* osx-10-10: 5
* linux64: 5
* linux32: 5
* windowsxp: 4
* windows8-32: 4
* windows7-32: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1220614&startday=2015-11-02&endday=2015-11-08&tree=all