Closed Bug 1525783 Opened 5 years ago Closed 5 years ago

windows/1803 - TEST-UNEXPECTED-PASS | font-face/variation-format-hint-1a.html

Categories

(Core :: CSS Parsing and Computation, defect, P5)

Product:
Core
Component:
CSS Parsing and Computation
Type:
defect

Tracking

()

Status:
RESOLVED FIXED

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

#[markdown(off)]
Filed by: egao [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=226341282&repo=try

https://queue.taskcluster.net/v1/task/II8nb_9YSP2OuWNQSp6iUw/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/II8nb_9YSP2OuWNQSp6iUw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Issue observed during win10/aarch64 test run.

This issue covers a combined 4 unexpected outcomes, for:

variation-format-hint-1a.html
06:53:53 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-ttf-ref.html | image comparison, max difference: 0, number of differing pixels: 0

variation-format-hint-1b.html
06:53:53 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-otf-ref.html | image comparison, max difference: 0, number of differing pixels: 0

variation-format-hint-1c.html
06:53:53 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff-ref.html | image comparison, max difference: 0, number of differing pixels: 0

variation-format-hint-1d.html
06:53:53 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1549435046/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff2-ref.html | image comparison, max difference: 0, number of differing pixels: 0

these issues are actually related to windows 1803 vs what we have been running in 1703, in bug 1522900, I will be adjusting the manifests to make this work. Given that these are unexpected-pass, this is good news!

Depends on: 1522900
Keywords: intermittent-failure, regression
Summary: TEST-UNEXPECTED-PASS | font-face/variation-format-hint-1a.html → windows/aarch64 - TEST-UNEXPECTED-PASS | font-face/variation-format-hint-1a.html
Summary: windows/aarch64 - TEST-UNEXPECTED-PASS | font-face/variation-format-hint-1a.html → windows/1803 - TEST-UNEXPECTED-PASS | font-face/variation-format-hint-1a.html

Try:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=c0abb56001522773bc87748f6042efc97dc45797

Outcome:

variation-format-hint-1a.html: TEST-PASS
variation-format-hint-1b.html: TEST-PASS
variation-format-hint-1c.html: TEST-PASS
variation-format-hint-1d.html: TEST-PASS

Relevant sections:

19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html | 134 / 142 (94%)
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | 134 / 142 (94%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html | 135 / 142 (95%)
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | 135 / 142 (95%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html | 136 / 142 (95%)
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | 136 / 142 (95%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html | 137 / 142 (96%)
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST INFO | SET PREFERENCE pref(layout.css.font-variations.enabled,false)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | 137 / 142 (96%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1A-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-ttf-ref.html
19:27:49     INFO - REFTEST INFO | RESTORE PREFERENCE pref(layout.css.font-variations.enabled,true)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html | 138 / 142 (97%)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-ttf-ref.html | 138 / 142 (97%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-ttf-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1a.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-ttf-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-otf-ref.html
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html | 139 / 142 (97%)
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-otf-ref.html | 139 / 142 (97%)
19:27:49     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-otf-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:49     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1b.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-otf-ref.html
19:27:49     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff-ref.html
19:27:49     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html | 140 / 142 (98%)
19:27:50     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff-ref.html | 140 / 142 (98%)
19:27:50     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:50     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1c.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff-ref.html
19:27:50     INFO - REFTEST TEST-START | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff2-ref.html
19:27:50     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html | 141 / 142 (99%)
19:27:50     INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff2-ref.html | 141 / 142 (99%)
19:27:50     INFO - REFTEST TEST-PASS | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff2-ref.html | image comparison, max difference: 0, number of differing pixels: 0
19:27:50     INFO - REFTEST TEST-END | file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1d.html == file:///C:/tasks/task_1551208547/build/tests/reftest/tests/layout/reftests/font-face/variation-format-hint-1B-woff2-ref.html
19:27:50     INFO - REFTEST INFO | Slowest test took 5062ms (http://localhost:50306/1551209235768/14/font-face/font-display-2.html)
19:27:50     INFO - REFTEST INFO | Total canvas count = 0

This issue can be closed as resolved after the windows 10 build 1803 upgrade.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.