Marionette should output TEST-UNEXPECTED-FAIL for all failures

RESOLVED FIXED in mozilla18

Status

defect
RESOLVED FIXED
7 years ago
7 years ago

People

(Reporter: jgriffin, Assigned: jgriffin)

Tracking

unspecified
mozilla18
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(1 attachment)

TBPL provides links to failures, based on the string TEST-UNEXPECTED-FAIL.  We currently emit this for failing JS assertions, but not for failed Python tests.  We should add this.
I'm trying out a patch for this on try, which includes a deliberate test failure: 

https://tbpl.mozilla.org/?tree=Try&rev=257e2e949f34
Blocks: 770769
Summary: Marionette should output TEXT-UNEXPECTED-FAIL for all failures → Marionette should output TEST-UNEXPECTED-FAIL for all failures
This patch allows TBPL to correctly recognize failures in Marionette Python tests (it already handles them for JS tests).  It works as this try submission shows:  https://tbpl.mozilla.org/?tree=Try&rev=09060e7768e5&noignore=1.  The failure is a deliberate failure I added to that submission just to verify this code
Attachment #663131 - Flags: review?(mdas)
Comment on attachment 663131 [details] [diff] [review]
Add TEST-UNEXPECTED-FAIL output to Marionette,

Review of attachment 663131 [details] [diff] [review]:
-----------------------------------------------------------------

Mmm, flavoured error logs.
Attachment #663131 - Flags: review?(mdas) → review+
https://hg.mozilla.org/mozilla-central/rev/5dde4b86acfb
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla18
You need to log in before you can comment on or make changes to this bug.