1116829 - Intermittent 966992-1.html | image comparison (==), max difference: 5, number of differing pixels: 145

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Attachment: TEST.png

02:46:00 INFO - REFTEST INFO | Loading a blank page
02:46:00 INFO - REFTEST TEST-END | http://10.0.2.2:8888/tests/layout/reftests/bugs/960277-1.html
02:46:00 INFO - REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html
02:46:00 INFO - SET PREFERENCE pref(layout.css.overflow-clip-box.enabled,true)
02:46:00 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html | 456 / 591 (77%)
02:46:00 INFO - RESTORE PREFERENCE pref(layout.css.overflow-clip-box.enabled,false)
02:46:00 INFO - SET PREFERENCE pref(layout.css.overflow-clip-box.enabled,true)
02:46:00 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1-ref.html | 456 / 591 (77%)
02:46:00 INFO - REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html | image comparison (==), max difference: 5, number of differing pixels: 145 
02:46:00 INFO - REFTEST IMAGE 1 (TEST): 
02:46:06 INFO - REFTEST IMAGE 2 (REFERENCE): 
02:46:06 INFO - REFTEST INFO | Loading a blank page
02:46:06 INFO - REFTEST TEST-END | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html
02:46:06 INFO - REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/reftests/bugs/966510-1.html
02:46:06 INFO - RESTORE PREFERENCE pref(layout.css.overflow-clip-box.enabled,false)
02:46:06 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/bugs/966510-1.html | 457 / 591 (77%)
02:46:06 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/bugs/966510-1-ref.html | 457 / 591 (77%)
02:46:06 INFO - REFTEST TEST-PASS | http://10.0.2.2:8888/tests/layout/reftests/bugs/966510-1.html | image comparison (==)

Comment 1

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Attachment: REFERENCE.png

Comment 2

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-12-31T11:54:40
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-central&job_id=823835
repository: mozilla-central
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1147
buildname: b2g_emulator_vm mozilla-central opt test reftest-7
revision: 88037f94b7d7

Can't download from http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/sha512/263f4e8796c25543f64ba36e53d5c4ab8ed4d4e919226037ac0988761d34791b038ce96a8ae434f0153f9c2061204086decdbff18bdced42f3849156ae4dc9a4 to /builds/slave/test/build/263f4e8796c25543f64ba36e53d5c4ab8ed4d4e919226037ac0988761d34791b038ce96a8ae434f0153f9c2061204086decdbff18bdced42f3849156ae4dc9a4!
Caught exception: HTTP Error 404: Not Found
Caught exception: HTTP Error 404: Not Found
Caught exception: HTTP Error 404: Not Found
REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html | image comparison (==), max difference: 5, number of differing pixels: 145
Return code: 1

Comment 3

[Mats Palmgren (inactive)]

(In reply to TBPL Robot from comment #2)
> REFTEST TEST-UNEXPECTED-FAIL |
> http://10.0.2.2:8888/tests/layout/reftests/bugs/966992-1.html | image
> comparison (==), max difference: 5, number of differing pixels: 145


# grep 966992-1.html layout/reftests/bugs/reftest.list 
pref(layout.css.overflow-clip-box.enabled,true) fuzzy(50,145) == 966992-1.html 966992-1-ref.html

Hmm, it looks like it's within the allowed range, so why was this reported
as a failure?

... looks at the file blame ...

Ah, the "fuzzy" counts were recently bumped up in:
http://hg.mozilla.org/mozilla-central/diff/c1dc4e9356f8/layout/reftests/bugs/reftest.list
so this should now be fixed!

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9033721
repository: mozilla-inbound
start_time: 2015-04-19T07:29:15
who: philringnalda[at]gmail[dot]com
machine: unknown
revision: ffde08dc5ceb

REFTEST TEST-UNEXPECTED-FAIL | file:///home/worker/build/tests/reftest/tests/layout/reftests/bugs/966992-1.html | image comparison (==), max difference: 255, number of differing pixels: 3994