Created attachment 588768 [details] [diff] [review] Add fuzzy-max option In some cases we want to support differences in reftests greater than 2 (skia in particular). I feel that it's better to have this configurable rather than disabling the tests entirely.
I actually think the maximum number of different pixels, and the maximum difference per pixel, should be mandatory parameters to 'fuzzy'/'fuzzy-if'.
Created attachment 590114 [details] [diff] [review] Add max values to fuzzy/fuzzy-if instead Alternative option that roc suggested.
Created attachment 590619 [details] [diff] [review] Add max values to fuzzy/fuzzy-if instead v2 Updated tolerance values to match the failures seen on tinderbox, and updated for new fuzzy tests that have been added since the previous patch was posted. dbaron: Do you mind if roc reviews this?
https://hg.mozilla.org/mozilla-central/rev/05df0cddc299 Presume the other patch is now obsolete?
This patch should have updated the documentation. This has now been reported twice; see bug 729784.