1307152 - Intermittent test_fallback_update.py test_direct_update.py TestFallbackUpdate.test_update | AssertionError: firefox_puppeteer.ui.about_window.deck.DownloadFailedPanel == firefox_puppeteer.ui.about_window.deck.DownloadFailedPanel

Status: VERIFIED INCOMPLETE

(Testing :: Firefox UI Tests, defect)

Description

[Treeherder Bug Filer]

Filed by: mfrydrychowicz [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=3722344&repo=mozilla-aurora

https://firefox-ui-tests.s3.amazonaws.com/e376a128-53e4-419b-8d80-fa737bcaf3f4/log_info.log

Comment 1

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

08:38:07     INFO -  MARIONETTE LOG: INFO: TEST-START: c:\jenkins\workspace\mozilla-aurora_update\build\tests\firefox-ui\tests\update\fallback\test_fallback_update.py:test_update
08:38:08     INFO - Clean-up update staging directory: C:\Users\mozauto\AppData\Local\Mozilla\updates\5FC44D6E9F1A2441\updates
08:38:08     INFO -  *** AUS:SVC Creating UpdateService
08:38:43  WARNING - Failed to gather test failure debug.
08:38:43  WARNING - Traceback (most recent call last):
08:38:43  WARNING - 
08:38:43  WARNING -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette\runner\base.py", line 569, in gather_debug
08:38:43  WARNING -     rv['source'] = marionette.page_source
08:38:43  WARNING - 
08:38:43  WARNING -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette_driver\marionette.py", line 1307, in page_source
08:38:43  WARNING -     return self._send_message("getPageSource", key="value")
08:38:43  WARNING - 
08:38:43  WARNING -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette_driver\decorators.py", line 42, in _
08:38:43  WARNING -     return func(*args, **kwargs)
08:38:43  WARNING - 
08:38:43  WARNING -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette_driver\marionette.py", line 693, in _send_message
08:38:43  WARNING -     self._handle_error(err)
08:38:43  WARNING - 
08:38:43  WARNING -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette_driver\marionette.py", line 726, in _handle_error
08:38:43  WARNING -     raise errors.lookup(error)(message, stacktrace=stacktrace)
08:38:43  WARNING - 
08:38:43  WARNING - NoSuchWindowException: No such content frame; perhaps the listener was not registered?
08:38:43  WARNING - 
08:38:43     INFO - TEST-UNEXPECTED-FAIL | test_fallback_update.py TestFallbackUpdate.test_update | AssertionError: <firefox_puppeteer.ui.about_window.deck.DownloadFailedPanel object at 0x037ADC10> == <firefox_puppeteer.ui.about_window.deck.DownloadFailedPanel object at 0x037AD870>
08:38:43     INFO - Traceback (most recent call last):
08:38:43     INFO -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\marionette\marionette_test\testcases.py", line 162, in run
08:38:43     INFO -     testMethod()
08:38:43     INFO -   File "c:\jenkins\workspace\mozilla-aurora_update\build\tests\firefox-ui\tests\update\fallback\test_fallback_update.py", line 20, in test_update
08:38:43     INFO -     self.download_and_apply_available_update(force_fallback=True)
08:38:43     INFO -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\firefox_ui_harness\testcases.py", line 308, in download_and_apply_available_update
08:38:43     INFO -     self.download_update(about_window)
08:38:43     INFO -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\firefox_ui_harness\testcases.py", line 290, in download_update
08:38:43     INFO -     self.wait_for_download_finished(window, timeout)
08:38:43     INFO -   File "c:\jenkins\workspace\mozilla-aurora_update\build\venv\lib\site-packages\firefox_ui_harness\testcases.py", line 431, in wait_for_download_finished
08:38:43     INFO -     window.deck.download_failed)
08:38:43     INFO - TEST-INFO took 38115ms
08:38:43  WARNING - [Errno 2] No such file or directory: u'C:\\Users\\mozauto\\AppData\\Local\\Mozilla\\updates\\5FC44D6E9F1A2441\\updates\\last-update.log'
08:38:43     INFO - Update test results: 
08:38:43     INFO - [{'build_post': None,
08:38:43     INFO -   'build_pre': {'buildid': u'20160928004008',
08:38:43     INFO -                 'channel': u'aurora',
08:38:43     INFO -                 'disabled_addons': None,
08:38:43     INFO -                 'locale': u'ru',
08:38:43     INFO -                 'mar_channels': set([u'firefox-mozilla-aurora']),
08:38:43     INFO -                 'update_snippet': '<?xml version="1.0"?>\n<updates>\n    <update type="minor" displayVersion="51.0a2" appVersion="51.0a2" platformVersion="51.0a2" buildID="20161002004009">\n        <patch type="complete" URL="https://mozilla-nightly-updates.s3.amazonaws.com/mozilla-aurora/20161002004009/Firefox-mozilla-aurora-51.0a2-win32-ru.complete.mar?versionId=6lgbD2m.cekA58wBJEjC.TxJ0YF3XJ9Q" hashFunction="sha512" hashValue="090b65fbf4dd9dc09a09d2164ac5f83d76cd6fc927ce573783fc8d11cf2d3b0d566fb78bbef360ac15c32c4c3969d956647cf1771775e78c143f7291c8c658c2" size="54985302"/>\n        <patch type="partial" URL="https://mozilla-nightly-updates.s3.amazonaws.com/mozilla-aurora/20161002004009/Firefox-mozilla-aurora-51.0a2-win32-ru-20160928004008-20161002004009.partial.mar?versionId=Qadz4QMqcE7d3fH9CK8nEVqByDENvybv" hashFunction="sha512" hashValue="3498783e33812e776725caf92e6f717a2a5f044da37425503a74374bbb903c0fe4e6d580f6079f08ea1a90cb5edaed066e6f553f6ef32e97c393c73c36efb9bb" size="11124906"/>\n    </update>\n</updates>',
08:38:43     INFO -                 'update_url': u'https://aus5.mozilla.org/update/6/Firefox/51.0a2/20160928004008/WINNT_x86-msvc-x64/ru/aurora/Windows_NT%206.1.1.0%20(x64)/SSE3/default/default/update.xml?force=1',
08:38:43     INFO -                 'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:51.0) Gecko/20100101 Firefox/51.0',
08:38:43     INFO -                 'version': u'51.0a2'},
08:38:43     INFO -   'fallback': True,
08:38:43     INFO -   'patch': {'buildid': u'20161002004009',
08:38:43     INFO -             'channel': u'aurora',
08:38:43     INFO -             'download_duration': None,
08:38:43     INFO -             'is_complete': True,
08:38:43     INFO -             'size': 54985302,
08:38:43     INFO -             'type': u'minor',
08:38:43     INFO -             'url_mirror': u'https://mozilla-nightly-updates.s3.amazonaws.com/mozilla-aurora/20161002004009/Firefox-mozilla-aurora-51.0a2-win32-ru.complete.mar?versionId=6lgbD2m.cekA58wBJEjC.TxJ0YF3XJ9Q',
08:38:43     INFO -             'version': u'51.0a2'},
08:38:43     INFO -   'success': False,
08:38:43     INFO -   'update_log': None}]
08:38:43     INFO - Clean-up update staging directory: C:\Users\mozauto\AppData\Local\Mozilla\updates\5FC44D6E9F1A2441\updates
08:38:43     INFO - Restoring channel defaults for: c:\jenkins\workspace\mozilla-aurora_update\build\application.copy\defaults\pref\channel-prefs.js

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The failure happens here:

https://dxr.mozilla.org/mozilla-central/source/testing/firefox-ui/harness/firefox_ui_harness/testcases.py#430

It means the download of the update has been failed. So not really a test failure. Given that we do not have AUS logging visible on Windows its hard to tell, what this is.