1092170 - Passing marionette test runs contain stack traces for tests skipped through an annotation

Status: RESOLVED DUPLICATE of bug 1090962

(Remote Protocol :: Marionette, defect)

Description

[Chris Manchester (limited bugmail, email directly)]

I don't think this is all that serious, but a little disconcerting. Clicking on a passing marionette run on treeherder results in a failure summary with the tail of a stack trace for three tests skipped with an annotation. I don't know where we would say the bug is, or if there is one, or in fact why we aren't just skipping these from manifests. A full sample error text is:

"""
06:01:26     INFO -  TEST-START | test_click_scrolling.py TestClickScrolling.test_should_be_able_to_click_on_an_element_hidden_by_overflow
06:01:26     INFO -  Failed to gather test failure debug.
06:01:26     INFO -  Traceback (most recent call last):
06:01:26     INFO -    File "/builds/slave/talos-slave/test/build/tests/marionette/marionette/runner/base.py", line 502, in gather_debug
06:01:26     INFO -      marionette.set_context(marionette.CONTEXT_CHROME)
06:01:26     INFO -    File "/builds/slave/talos-slave/test/build/tests/marionette/marionette/marionette.py", line 967, in set_context
06:01:26     INFO -      return self._send_message('setContext', 'ok', value=context)
06:01:26     INFO -    File "/builds/slave/talos-slave/test/build/tests/marionette/marionette/decorators.py", line 36, in _
06:01:26     INFO -      return func(*args, **kwargs)
06:01:26     INFO -    File "/builds/slave/talos-slave/test/build/tests/marionette/marionette/marionette.py", line 606, in _send_message
06:01:26     INFO -      raise errors.MarionetteException("Please start a session")
06:01:26     INFO -  MarionetteException: MarionetteException: Please start a session
06:01:26     INFO -  TEST-SKIP | test_click_scrolling.py TestClickScrolling.test_should_be_able_to_click_on_an_element_hidden_by_overflow | took 1ms
"""