1604347 - ubuntu1804 - layout/reftests/svg/text/reftest.list | unexpected pass

Status: RESOLVED FIXED

(Core :: SVG, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: egao [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281172960&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LR-JVzCGSw6wqKJf5YGhUA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LR-JVzCGSw6wqKJf5YGhUA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

suite: reftest
chunk: 3

note: qr

context:
[task 2019-12-14T09:58:21.104Z] 09:58:21 INFO - REFTEST TEST-START | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection.svg == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection-ref.html
[task 2019-12-14T09:58:21.105Z] 09:58:21 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection.svg | 160 / 170 (94%)
[task 2019-12-14T09:58:21.192Z] 09:58:21 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection-ref.html | 160 / 170 (94%)
[task 2019-12-14T09:58:21.281Z] 09:58:21 INFO - REFTEST INFO | REFTEST fuzzy test (1, 35) <= (0, 0) <= (1, 237)
[task 2019-12-14T09:58:21.485Z] 09:58:21 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection.svg == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/text/simple-selection-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-12-14T09:58:21.485Z] 09:58:21 INFO - REFTEST IMAGE 1 (TEST):

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

:svoisen - proposing something similar to bug 1604338 here as well. Multiple tests in this chunk unexpectedly pass on ubuntu1804, so I would like to temporarily lower the bottom pixel threshold while ubuntu1804 and ubuntu1604 is both present, then remove the annotation altogether once ubuntu1604 is decommissioned in 2020.

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1604347 - annotate unexpected passes in layout/reftests/svg/text/reftest.list when run on ubuntu1804

Comment 3

[Edwin Takahashi (:egao | infrequent contributor)]

leave-open such that once the migration to ubuntu1804 is complete and ubuntu1604 is no longer actively running these tests, remove the redundant annotation.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c5a0a59e597d
annotate unexpected passes in layout/reftests/svg/text/reftest.list when run on ubuntu1804 r=jmaher

Comment 5

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/c5a0a59e597d

Comment 6

[Sean Voisen (:svoisen)]

Clearing my old needinfo — Edwin and I discussed the proposal in comment 1, which seems fine.