reftest harness should print pixel delta information on the UNEXPECTED-FAIL line

RESOLVED FIXED in Firefox 17

Status

Testing
Reftest
RESOLVED FIXED
5 years ago
3 years ago

People

(Reporter: dbaron, Assigned: dbaron)

Tracking

Trunk
mozilla18
Points:
---

Firefox Tracking Flags

(firefox17 fixed)

Details

(Whiteboard: [qa-])

Attachments

(1 attachment)

(Assignee)

Description

5 years ago
Created attachment 659368 [details] [diff] [review]
patch

Right now the reftest harness prints the pixel errors (number of pixels and maximum color difference) below the images.  Since they're not on the same line as the TEST-UNEXPECTED-FAIL, they don't end up in intermittent-orange bugs.  In some cases, having it in the bugs would be very useful for annotating the problem as a known failure.

This would, however, be very useful data to have on intermittent orange bugs, so we ought to have this on the same line as the TEST-UNEXPECTED-FAIL message.
Attachment #659368 - Flags: review?(ted.mielczarek)
(Assignee)

Updated

5 years ago
Assignee: nobody → dbaron
Status: NEW → ASSIGNED
Attachment #659368 - Flags: review?(ted.mielczarek) → review+
(Assignee)

Comment 1

5 years ago
https://hg.mozilla.org/integration/mozilla-inbound/rev/acb63df12b7a
https://hg.mozilla.org/mozilla-central/rev/acb63df12b7a
Status: ASSIGNED → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla18

Comment 3

5 years ago
Landed on beta so we have this for ESR17 for the next year.

https://hg.mozilla.org/releases/mozilla-beta/rev/8739f223b6e2
status-firefox17: --- → fixed
Whiteboard: [qa-]
(Assignee)

Comment 4

3 years ago
https://hg.mozilla.org/integration/mozilla-inbound/rev/e8c41ecfc045
https://hg.mozilla.org/mozilla-central/rev/e8c41ecfc045
You need to log in before you can comment on or make changes to this bug.