Closed Bug 1696069 Opened 4 years ago Closed 1 year ago

Intermittent bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64

Categories

(Core :: Graphics: WebRender, defect)

defect

Tracking

()

RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Assigned: jgilbert)

References

(Blocks 1 open bug, Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell unknown])

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=331829503&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UwheWahTTBmHYJXhErVbkg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UwheWahTTBmHYJXhErVbkg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2021-03-03T00:12:17.003Z] 00:12:17     INFO - REFTEST TEST-START | layout/reftests/bugs/446100-1a.html == about:blank
[task 2021-03-03T00:12:17.003Z] 00:12:17     INFO - REFTEST TEST-LOAD | file:///C:/Users/task_1614728950/build/tests/reftest/tests/layout/reftests/bugs/446100-1a.html | 1121 / 2051 (54%)
[task 2021-03-03T00:12:17.024Z] 00:12:17     INFO - [Child 5564, Main Thread] WARNING: Scrolled rect smaller than scrollport?: file /builds/worker/checkouts/gecko/layout/generic/nsGfxScrollFrame.cpp:7050
[task 2021-03-03T00:12:17.024Z] 00:12:17     INFO - [Child 5564, Main Thread] WARNING: Scrolled rect smaller than scrollport?: file /builds/worker/checkouts/gecko/layout/generic/nsGfxScrollFrame.cpp:7053
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0...
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0K...
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST INFO | Saved log: START file:///C:/Users/task_1614728950/build/tests/reftest/tests/layout/reftests/bugs/446100-1a.html
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2021-03-03T00:12:17.123Z] 00:12:17     INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2021-03-03T00:12:17.124Z] 00:12:17     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2021-03-03T00:12:17.124Z] 00:12:17     INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2021-03-03T00:12:17.124Z] 00:12:17     INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2021-03-03T00:12:17.124Z] 00:12:17     INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2021-03-03T00:12:17.124Z] 00:12:17     INFO - REFTEST TEST-END | layout/reftests/bugs/446100-1a.html == about:blank
[task 2021-03-03T00:12:17.125Z] 00:12:17     INFO - REFTEST TEST-START | layout/reftests/bugs/446100-1b.html == about:blank
[task 2021-03-03T00:12:17.125Z] 00:12:17     INFO - REFTEST TEST-LOAD | file:///C:/Users/task_1614728950/build/tests/reftest/tests/layout/reftests/bugs/446100-1b.html | 1122 / 2051 (54%)
[task 2021-03-03T00:12:17.144Z] 00:12:17     INFO - [Child 5564, Main Thread] WARNING: Scrolled rect smaller than scrollport?: file /builds/worker/checkouts/gecko/layout/generic/nsGfxScrollFrame.cpp:7050
[task 2021-03-03T00:12:17.144Z] 00:12:17     INFO - [Child 5564, Main Thread] WARNING: Scrolled rect smaller than scrollport?: file /builds/worker/checkouts/gecko/layout/generic/nsGfxScrollFrame.cpp:7053
[task 2021-03-03T00:12:17.244Z] 00:12:17     INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/446100-1b.html == about:blank | image comparison, max difference: 191, number of differing pixels: 127
[task 2021-03-03T00:12:17.244Z] 00:12:17     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGg..
...```
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE

Daniel, this along with the other failure lines seen in the logs are permafailing since Bug 1717912 landed (central push range).
Could you please take a look?

Flags: needinfo?(dholbert)
See Also: → 1718438
Summary: Intermittent bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64 → Intermittent windows10-aarch64-qr bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64
See Also: → 1719114
See Also: → 1718427

There are 21 total failures in the last 7 days on windows10-aarch64-qr opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=344519404&repo=mozilla-central&lineNumber=6986

[task 2021-07-07T00:17:52.723Z] 00:17:52 INFO - REFTEST TEST-START | layout/reftests/bugs/446100-1a.html == about:blank
[task 2021-07-07T00:17:52.728Z] 00:17:52 INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1625613000/build/tests/reftest/tests/layout/reftests/bugs/446100-1a.html | 1121 / 2048 (54%)
[task 2021-07-07T00:17:53.145Z] 00:17:53 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/446100-1a.html == about:blank | image comparison, max difference: 87, number of differing pixels: 73

Whiteboard: [stockwell needswork:owner]

(In reply to Alexandru Michis [:malexandru] from comment #5)

Daniel, this along with the other failure lines seen in the logs are permafailing since Bug 1717912 landed (central push range).
Could you please take a look?

Sorry for the delay; I've been on vacation moving house & largely AFK.

This looks like a "real" test-failure (not something that we should annotate as fuzzy). reftest.list shows the test being expected to render blank, but it is rendering very-much not-blank. There are some quite-visible gray squares and lines in the reftest snapshots of this family of 446100-* tests.

Given the connection to bug 1717912, this is presumably a WebRender bug, and I'll tag aosmond to take a further look (since he's involved with WebRender and landed bug 1717912).

Component: Layout → Graphics: WebRender
Flags: needinfo?(dholbert) → needinfo?(aosmond)
Regressed by: 1717912
Has Regression Range: --- → yes

Update:
There have been 35 failures within the last 7 days on Windows 10 AArch64 WebRender opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=345534097&repo=autoland&lineNumber=2109

Summary: Intermittent windows10-aarch64-qr bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64 → Intermittent [tier 2] Windows 10 AArch64 bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64

This started to appear on Tier 1 jobs and also on Windows 10 x86 2004 WebRender debug platform.
Failure log: https://treeherder.mozilla.org/logviewer?job_id=351383246&repo=autoland&lineNumber=8279

Summary: Intermittent [tier 2] Windows 10 AArch64 bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64 → Intermittent bugs/446100-1a.html == about:blank | image comparison, max difference: 111, number of differing pixels: 64

Looking at the recent failures here, I noticed an interesting pattern:

  • The failure logs always seem to include failures for these same 5 tests (always all five of these):
446100-1a.html
446100-1b.html
446100-1d.html
446100-1e.html
446100-1g.html
  • After that, the failure logs usually also include a failure of 1424177.html and/or canvas-outside-document-invalidate-02.html

So it seems like there's some broader error-case that we get into (in WebRender?) that pretty-reliably makes us fail a bunch of neighboring tests, when it happens.

Assignee: nobody → jgilbert
Flags: needinfo?(jgilbert)
Regressed by: 1779866
Status: REOPENED → RESOLVED
Closed: 4 years ago1 year ago
Resolution: --- → WORKSFORME
Flags: needinfo?(aosmond)
You need to log in before you can comment on or make changes to this bug.