Closed Bug 1564891 Opened 5 years ago Closed 4 years ago

Intermittent svg/as-image/img-simple-3.html == svg/as-image/img-simple-3-ref.html | image comparison, max difference: 255, number of differing pixels: 3978

Categories

(Core :: SVG, defect, P5)

defect

Tracking

()

RESOLVED FIXED
mozilla75
Tracking Status
firefox-esr68 --- unaffected
firefox73 --- unaffected
firefox74 --- unaffected
firefox75 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: apavel)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [retriggered])

Attachments

(1 file)

Filed by: aciure [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=255686280&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/H3hu5yBRRFiT4IFJjufeIw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/H3hu5yBRRFiT4IFJjufeIw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


13:04:52 INFO - REFTEST TEST-START | http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html
13:04:52 INFO - REFTEST TEST-LOAD | http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3.html | 187 / 1918 (9%)
13:04:52 INFO - REFTEST TEST-LOAD | http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html | 187 / 1918 (9%)
13:04:52 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (255, 3978) <= (255, 3714)
13:04:52 INFO - REFTEST TEST-UNEXPECTED-FAIL | http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html | image comparison, max difference: 255, number of differing pixels: 3978
13:04:52 INFO - REFTEST TEST-END | http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.218:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html

Type: -- → defect
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE

This is still happening.

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=278925232&repo=mozilla-central&lineNumber=3702

[task 2019-12-01T10:27:12.368Z] 10:27:01 INFO - REFTEST TEST-START | http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html
[task 2019-12-01T10:27:12.368Z] 10:27:01 INFO - REFTEST TEST-LOAD | http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3.html | 220 / 1939 (11%)
[task 2019-12-01T10:27:12.368Z] 10:27:01 INFO - REFTEST TEST-LOAD | http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html | 220 / 1939 (11%)
[task 2019-12-01T10:27:12.368Z] 10:27:12 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (255, 3978) <= (255, 3850)
[task 2019-12-01T10:27:12.368Z] 10:27:12 WARNING - REFTEST TEST-UNEXPECTED-FAIL | http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html | image comparison, max difference: 255, number of differing pixels: 3978
[task 2019-12-01T10:27:12.386Z] 10:27:12 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAAAAPoCAYAAAAmy5qxAAAgAElEQVR4nO3...
[task 2019-12-01T10:27:12.388Z] 10:27:12 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAA...
[task 2019-12-01T10:27:12.388Z] 10:27:12 INFO - REFTEST TEST-END | http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3.html == http://10.7.205.204:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

There is no way that a test-only mochitest-bc change affects reftest. I happened to encounter this bug while running a try.

Flags: needinfo?(VYV03354)

Sean can you please assign someone to take a look?

Masatoshi, thank you for looking.

Flags: needinfo?(svoisen)

There are 27 total failures in the last 7 days on android-hw-p2-8-0-android-aarch64-qr

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=288033299&repo=mozilla-central&lineNumber=2742

[task 2020-02-08T10:24:34.406Z] 10:24:34 INFO - REFTEST TEST-START | layout/reftests/svg/as-image/img-simple-3.html == layout/reftests/svg/as-image/img-simple-3-ref.html
[task 2020-02-08T10:24:34.406Z] 10:24:34 INFO - REFTEST TEST-LOAD | http://10.7.205.238:8854/tests/layout/reftests/svg/as-image/img-simple-3.html | 158 / 1910 (8%)
[task 2020-02-08T10:24:34.406Z] 10:24:34 INFO - REFTEST TEST-LOAD | http://10.7.205.238:8854/tests/layout/reftests/svg/as-image/img-simple-3-ref.html | 158 / 1910 (8%)
[task 2020-02-08T10:24:34.406Z] 10:24:34 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (255, 4027) <= (255, 3850)
[task 2020-02-08T10:24:34.406Z] 10:24:34 WARNING - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/svg/as-image/img-simple-3.html == layout/reftests/svg/as-image/img-simple-3-ref.html | image comparison, max difference: 255, number of differing pixels: 4027

Emilio do you have any insight here?

Flags: needinfo?(emilio)

Seems like the test should be marked as a bit more fuzzy in the WR+geckoview configuration.

Flags: needinfo?(emilio)
Assignee: nobody → apavel
Pushed by apavel@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/a1b2326226a4
increase fuzzy in img-simple-3-ref.html r=emilio
Status: REOPENED → RESOLVED
Closed: 5 years ago4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla75
Flags: needinfo?(svoisen)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: