1794065 - Intermittent font-face/colrv1-01.html#L == font-face/colrv1-01-ref.html#L | image comparison, max difference: 255, number of differing pixels: 1260

Status: RESOLVED INCOMPLETE

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=392518782&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YUhCDjFzSUKx2myrBLw7dg/runs/1/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YUhCDjFzSUKx2myrBLw7dg/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2022-10-06T23:57:31.110Z] 23:57:31     INFO -  REFTEST TEST-START | layout/reftests/font-face/colrv1-01.html#L == layout/reftests/font-face/colrv1-01-ref.html#L
[task 2022-10-06T23:57:31.110Z] 23:57:31     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/layout/reftests/font-face/colrv1-01.html#L | 1899 / 2210 (85%)
[task 2022-10-06T23:57:31.110Z] 23:57:31     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/layout/reftests/font-face/colrv1-01-ref.html#L | 1899 / 2210 (85%)
[task 2022-10-06T23:57:31.110Z] 23:57:31     INFO -  REFTEST INFO | REFTEST fuzzy test (0, 0) <= (255, 1260) <= (1, 851)
[task 2022-10-06T23:57:31.112Z] 23:57:31  WARNING -  REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/font-face/colrv1-01.html#L == layout/reftests/font-face/colrv1-01-ref.html#L | image comparison, max difference: 255, number of differing pixels: 1260
[task 2022-10-06T23:57:31.139Z] 23:57:31     INFO -  REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAAAAPoCAYAAAAmy5qxAAAgAElEQVR4XuzdB5SlWVUv8K/TTM9MzwxDMiuYA5hdgjlnfWYFMyiYFhhAfSqoYAYTPrNgBl0mzDkHMAcwPVQwB9KEnume6erud/ft3tWnTn/3VjWD+13u...
[task 2022-10-06T23:57:31.166Z] 23:57:31     INFO -  REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAAAAPoCAYAAAAmy5qxAAAgAElEQVR4XuzdeYzl2VUf8F9v456ZnhmPF/gDSGwQi8AW6x84/AFhkxIggQQB9h/sq0AYkEFhcQQxiEggECYgFrMIEAYBCQQBIoRVBINIEMiOEAF...
[task 2022-10-06T23:57:31.166Z] 23:57:31     INFO -  REFTEST TEST-END | layout/reftests/font-face/colrv1-01.html#L == layout/reftests/font-face/colrv1-01-ref.html#L
[task 2022-10-06T23:57:31.166Z] 23:57:31     INFO -  REFTEST TEST-START | layout/reftests/font-face/colrv1-01.html#M == layout/reftests/font-face/colrv1-01-ref.html#M

Comment 1

[Natalia Csoregi [:nataliaCs]]

Caused by Bug 1793611.

Jonathan can you please take a look at this?
Thank you.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1793611

Comment 3

[Jonathan Kew [:jfkthame]]

The screenshots here show an unexpected blank area in the reference rendering, which looks like a graphics-level painting glitch of some kind rather than anything related to COLR font rendering. As such, it's hard to see how it would be caused by bug 1793611, which touched only the COLR rendering code (not used by the reference file here).

Let's see if this recurs with any sort of frequency....

Comment 4

[Intermittent Failures Robot]

4 failures in 2449 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794065&startday=2022-10-03&endday=2022-10-09&tree=all

Comment 5

[Intermittent Failures Robot]

3 failures in 3034 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794065&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1793611

Comment 7

[Intermittent Failures Robot]

2 failures in 2793 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794065&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 8

[Daniel Holbert [:dholbert]]

FWIW: so far, this has only ever happened on android-em-7-0-x86_64-qr / debug, with 10 total failures.

Comment 9

[Daniel Holbert [:dholbert]]

Attachment: screenshot showing unexpectedly-blank area in the reference case screenshot (plus a 1px tall strip of lime)

Here's a screenshot of the reference case from one of the recent failures.

Red scribbles added by me to make the problematic/mismatching parts obvious

Comment 10

[Intermittent Failures Robot]

1 failures in 3743 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794065&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.