Closed Bug 789602 Opened 9 years ago Closed 9 years ago

reftest harness should print pixel delta information on the UNEXPECTED-FAIL line

Categories

(Testing :: Reftest, defect)

defect
Not set
normal

Tracking

(firefox17 fixed)

RESOLVED FIXED
mozilla18
Tracking Status
firefox17 --- fixed

People

(Reporter: dbaron, Assigned: dbaron)

Details

(Whiteboard: [qa-])

Attachments

(1 file)

Attached patch patchSplinter Review
Right now the reftest harness prints the pixel errors (number of pixels and maximum color difference) below the images.  Since they're not on the same line as the TEST-UNEXPECTED-FAIL, they don't end up in intermittent-orange bugs.  In some cases, having it in the bugs would be very useful for annotating the problem as a known failure.

This would, however, be very useful data to have on intermittent orange bugs, so we ought to have this on the same line as the TEST-UNEXPECTED-FAIL message.
Attachment #659368 - Flags: review?(ted.mielczarek)
Assignee: nobody → dbaron
Status: NEW → ASSIGNED
Attachment #659368 - Flags: review?(ted.mielczarek) → review+
https://hg.mozilla.org/mozilla-central/rev/acb63df12b7a
Status: ASSIGNED → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla18
Landed on beta so we have this for ESR17 for the next year.

https://hg.mozilla.org/releases/mozilla-beta/rev/8739f223b6e2
Whiteboard: [qa-]
You need to log in before you can comment on or make changes to this bug.