758834 - Add ability to flag tests to be skipped in the manifest

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect)

Description

[Jonathan Griffin (:jgriffin)]

We can mark Python test methods as expected failures using the @unittest.expectedFailure decorator, but we don't have a mechanism of marking JS tests.

We should add a skip flag to the manifest, which if set to true would cause the test to be entirely skipped.

Comment 1

[Jonathan Griffin (:jgriffin)]

http://hg.mozilla.org/mozilla-central/rev/c3f6681b9877

Tests can now be flagged to be skipped by adding

skip = true

in their manifest section.

This is not exactly the same as the @unittest.expectedFailure decorator for Python, as that causes the test to be run and will fail if the test succeeds.  This patch just allows us to skip tests.

We should probably add an expectedfailure flag to the manifest as well, which would have a similar effect, but that's a little more complicated to hook up, so I'll handle that in a separate patch.