1604200 - Intermittent high-contrast/selection-001.html == high-contrast/selection-001-ref.html | image comparison, max difference: 255, number of differing pixels: 3116

Status: RESOLVED FIXED

(Core :: Graphics: WebRender, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281368822&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TfgjShDXQsmXw_PIiYY8Ew/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TfgjShDXQsmXw_PIiYY8Ew/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

orange background disappears

Comment 1

[Intermittent Failures Robot]

9 failures in 4582 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9

Platform breakdown:

• linux64-qr: 8
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 2

[Emilio Cobos Álvarez (:emilio)]

This seems to only happen with WebRender.

Comment 3

[Intermittent Failures Robot]

4 failures in 1365 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 2

Platform breakdown:

• linux64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2019-12-23&endday=2019-12-29&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 1862 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2019-12-30&endday=2020-01-05&tree=all

Comment 5

[Intermittent Failures Robot]

20 failures in 4472 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 13
• try: 3
• mozilla-beta: 1

Platform breakdown:

• windows10-64-ccov: 1
• linux64-qr: 3
• linux1804-64-asan-qr: 2
• linux1804-64-qr: 3
• linux1804-64-asan: 5
• linux1804-64-shippable-qr: 2
• linux1804-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 6

[Intermittent Failures Robot]

15 failures in 3773 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• autoland: 10

Platform breakdown:

• linux1804-64: 4
• linux1804-64-asan: 4
• linux64-ccov: 1
• linux1804-64-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 7

[Intermittent Failures Robot]

21 failures in 4004 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 8
• try: 5

Platform breakdown:

• linux1804-64-qr: 8
• linux1804-64: 8
• linux1804-64-asan-qr: 1
• linux1804-64-asan: 3
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 8

[Intermittent Failures Robot]

15 failures in 2190 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #49 most frequent failure this week.

Repository breakdown:

• mozilla-central: 4
• autoland: 7
• try: 4

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64-qr: 5
• linux1804-64-asan-qr: 1
• linux1804-64-devedition: 1
• linux1804-64-asan: 2
• linux1804-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 9

[Andreea Pavel [:apavel]]

Emilio this is not happening only on Webrender anymore, does the component need to be changed?

Last 30 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2020-01-08&endday=2020-02-07&tree=trunk&bug=1604200

There are 21 total failures in the last 7 days on

linux1804-64 debug
linux1804-64-asan opt
linux1804-64-qr debug
linux1804-64-shippable-qr opt

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=288001150&repo=mozilla-central&lineNumber=9105

[task 2020-02-07T23:48:04.337Z] 23:48:04 INFO - REFTEST TEST-START | layout/reftests/high-contrast/selection-001.html == layout/reftests/high-contrast/selection-001-ref.html
[task 2020-02-07T23:48:04.344Z] 23:48:04 INFO - REFTEST INFO | SET PREFERENCE pref(browser.display.document_color_use,2)
[task 2020-02-07T23:48:04.345Z] 23:48:04 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001.html | 13 / 18 (72%)
[task 2020-02-07T23:48:04.409Z] 23:48:04 INFO - REFTEST INFO | RESTORE PREFERENCE pref(browser.display.document_color_use,0)
[task 2020-02-07T23:48:04.409Z] 23:48:04 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001-ref.html | 13 / 18 (72%)
[task 2020-02-07T23:48:04.645Z] 23:48:04 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/high-contrast/selection-001.html == layout/reftests/high-contrast/selection-001-ref.html | image comparison, max difference: 255, number of differing pixels: 3116

Jessie can you assign someone to take a look?

Comment 10

[Emilio Cobos Álvarez (:emilio)]

If it happens also on non-WR it may be a layout issue or an issue with the test. I'll investigate a bit.

Comment 11

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1604200 - Try to make high-contrast selection test more reliable. r=mats,dholbert

Use MozReftestInvalidate rather than onload, following the pattern of most of
the tests in layout/reftests/selection.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a7f4f5a7a8c4
Try to make high-contrast selection test more reliable. r=mats

Comment 13

[Narcis Beleuzu [:NarcisB]]

Backed out for reftest failures on selection-001.html

Backout link: https://hg.mozilla.org/integration/autoland/rev/6aa0f40d3baab2a57dc2baae30a4729564fffb9f
Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=288059327&repo=autoland&lineNumber=10108

Comment 14

[Intermittent Failures Robot]

23 failures in 3364 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #32 most frequent failure this week.

Repository breakdown:

• mozilla-central: 11
• autoland: 12

Platform breakdown:

• linux1804-64: 6
• linux1804-64-asan-qr: 7
• linux1804-64-asan: 3
• linux1804-64-shippable-qr: 3
• linux1804-64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 15

[Emilio Cobos Álvarez (:emilio)]

Well, I don't have time to look into this right at this very moment.

Comment 16

[Intermittent Failures Robot]

16 failures in 4690 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 5
• try: 1

Platform breakdown:

• linux1804-64: 4
• linux1804-64-asan: 5
• linux1804-64-shippable: 1
• linux1804-64-qr: 2
• linux1804-64-asan-qr: 3
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 17

[Intermittent Failures Robot]

19 failures in 4045 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• try: 2
• mozilla-beta: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 10
• linux1804-64-shippable-qr: 2
• linux1804-64: 3
• linux1804-64-devedition: 1
• linux1804-64-asan: 1
• linux1804-64-shippable: 1
• linux1804-64-asan-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 18

[Intermittent Failures Robot]

15 failures in 5233 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• try: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 3
• linux1804-64-asan: 3
• linux1804-64-shippable: 2
• linux1804-64-shippable-qr: 1
• linux1804-64-asan-qr: 3
• linux1804-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 19

[Andrei Ciure[:aciure]]

There are 20 failures associated to this bug in the last 7 days. These are occurring on linux1804-64-asan-qr opt and linux1804-64-qr debug.

recent log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=292121328&repo=autoland&lineNumber=10306

[task 2020-03-07T17:53:03.992Z] 17:53:03 INFO - REFTEST TEST-START | layout/reftests/high-contrast/selection-001.html == layout/reftests/high-contrast/selection-001-ref.html
[task 2020-03-07T17:53:03.992Z] 17:53:03 INFO - REFTEST INFO | SET PREFERENCE pref(browser.display.document_color_use,2)
[task 2020-03-07T17:53:03.993Z] 17:53:03 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001.html | 16 / 24 (66%)
[task 2020-03-07T17:53:04.126Z] 17:53:04 INFO - REFTEST INFO | RESTORE PREFERENCE pref(browser.display.document_color_use,0)
[task 2020-03-07T17:53:04.127Z] 17:53:04 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001-ref.html | 16 / 24 (66%)
[task 2020-03-07T17:53:04.491Z] 17:53:04 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/high-contrast/selection-001.html == layout/reftests/high-contrast/selection-001-ref.html | image comparison, max difference: 255, number of differing pixels: 3116
[task 2020-03-07T17:53:04.493Z] 17:53:04 INFO - REFTEST INFO | Saved log: START file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001.html
[task 2020-03-07T17:53:04.493Z] 17:53:04 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2020-03-07T17:53:04.493Z] 17:53:04 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2020-03-07T17:53:04.493Z] 17:53:04 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2020-03-07T17:53:04.494Z] 17:53:04 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2020-03-07T17:53:04.494Z] 17:53:04 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2020-03-07T17:53:04.496Z] 17:53:04 INFO - REFTEST INFO | Saved log: START file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/high-contrast/selection-001-ref.html
[task 2020-03-07T17:53:04.496Z] 17:53:04 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2020-03-07T17:53:04.497Z] 17:53:04 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2020-03-07T17:53:04.497Z] 17:53:04 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2020-03-07T17:53:04.498Z] 17:53:04 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2020-03-07T17:53:04.500Z] 17:53:04 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2020-03-07T17:53:04.500Z] 17:53:04 INFO - REFTEST TEST-END | layout/reftests/high-contrast/selection-001.html == layout/reftests/high-contrast/selection-001-ref.html

Comment 20

[Andreea Pavel [:apavel]]

Jessie since Emilio doesn't have the time for this right now, can you please take a look and assign it to someone?

Thank you.

Comment 21

[Emilio Cobos Álvarez (:emilio)]

If this is urgent I should probably take a look at it.

Comment 22

[Intermittent Failures Robot]

26 failures in 5483 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 18
• try: 3
• mozilla-central: 5

Platform breakdown:

• linux1804-64-qr: 12
• linux1804-64-asan: 2
• linux1804-64: 2
• android-hw-p2-8-0-android-aarch64-qr: 1
• linux1804-64-asan-qr: 7
• linux1804-64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 23

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1604200 - Second attempt at making this test more reliable. r=dholbert

It seems webrender has some invalidation issues on the test reference and won't
paint the selected text on time. Instead, run the selection ASAP so that it
hopefully paints soon enough.

Comment 24

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5068f7bd8bbe
Second attempt at making reftest selection-001.html more reliable. r=dholbert

Comment 25

[Oana Pop-Rus]

https://hg.mozilla.org/mozilla-central/rev/5068f7bd8bbe

Comment 26

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:emilio, is this bug important enough to require an uplift?
If not please set status_beta to wontfix.

For more information, please visit auto_nag documentation.

Comment 27

[Emilio Cobos Álvarez (:emilio)]

test-only, so probably wontfix

Comment 28

[Intermittent Failures Robot]

1 failures in 5336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604200&startday=2020-03-09&endday=2020-03-15&tree=all