As a security precaution, we have turned on the setting "Require API key authentication for API requests" for everyone. If this has broken something, please contact
Last Comment Bug 789602 - reftest harness should print pixel delta information on the UNEXPECTED-FAIL line
: reftest harness should print pixel delta information on the UNEXPECTED-FAIL line
Product: Testing
Classification: Components
Component: Reftest (show other bugs)
: Trunk
: All All
: -- normal (vote)
: mozilla18
Assigned To: David Baron :dbaron: ⌚️UTC-8
Depends on:
  Show dependency treegraph
Reported: 2012-09-07 14:57 PDT by David Baron :dbaron: ⌚️UTC-8
Modified: 2014-02-17 03:54 PST (History)
4 users (show)
See Also:
Crash Signature:
QA Whiteboard:
Iteration: ---
Points: ---

patch (2.46 KB, patch)
2012-09-07 14:57 PDT, David Baron :dbaron: ⌚️UTC-8
ted: review+
Details | Diff | Splinter Review

Description User image David Baron :dbaron: ⌚️UTC-8 2012-09-07 14:57:47 PDT
Created attachment 659368 [details] [diff] [review]

Right now the reftest harness prints the pixel errors (number of pixels and maximum color difference) below the images.  Since they're not on the same line as the TEST-UNEXPECTED-FAIL, they don't end up in intermittent-orange bugs.  In some cases, having it in the bugs would be very useful for annotating the problem as a known failure.

This would, however, be very useful data to have on intermittent orange bugs, so we ought to have this on the same line as the TEST-UNEXPECTED-FAIL message.
Comment 1 User image David Baron :dbaron: ⌚️UTC-8 2012-09-14 14:16:55 PDT
Comment 2 User image Ryan VanderMeulen [:RyanVM] 2012-09-14 18:15:21 PDT
Comment 3 User image Ed Morley [:emorley] 2012-10-15 05:44:28 PDT
Landed on beta so we have this for ESR17 for the next year.
Comment 4 User image David Baron :dbaron: ⌚️UTC-8 2014-02-16 16:08:23 PST
Comment 5 User image Carsten Book [:Tomcat] 2014-02-17 03:54:54 PST

Note You need to log in before you can comment on or make changes to this bug.