1610626 - Fix wrench reftest mode incorrectly printing unexpected in some cases

Status: RESOLVED FIXED

(Core :: Graphics: WebRender, defect)

Comment 1

[Glenn Watson [:gw]]

Attachment: Bug 1610626 - Fix wrench reftest mode incorrectly printing unexpected in some cases.

The semantics of the inaccuracy reftest mode are that the overall
test succeeds as long as one of the multiple test images mismatches
the reference image.

However, the previous implementation would print an unexpected result
if any of the comparisons were equal (even though the overall test
result would be reported correctly).

This patch changes wrench so that it only reports an unexpected
failure for the overall test, not each individual reference.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3d076ae68a94
Fix wrench reftest mode incorrectly printing unexpected in some cases. r=Bert

Comment 3

[Oana Pop-Rus]

https://hg.mozilla.org/mozilla-central/rev/3d076ae68a94