1630489 - Intermittent bugs/1553571-1.html == bugs/1553571-1-ref.html | load failed: timed out waiting for pending paint count to reach zero (waiting for MozAfterPaint) (waiting for updateCanvasPending)

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=297842818&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cXwRUU6bSheJZKRBBP1n8A/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cXwRUU6bSheJZKRBBP1n8A/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-04-16T00:58:17.466Z] 00:58:17 INFO - REFTEST TEST-START | layout/reftests/bugs/1553571-1.html == layout/reftests/bugs/1553571-1-ref.html
[task 2020-04-16T00:58:17.466Z] 00:58:17 INFO - REFTEST INFO | SET PREFERENCE pref(image.downscale-during-decode.enabled,true)
[task 2020-04-16T00:58:17.467Z] 00:58:17 INFO - REFTEST TEST-LOAD | file:///Z:/task_1586996919/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html | 2029 / 2050 (98%)
[task 2020-04-16T01:03:17.519Z] 01:03:17 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/1553571-1.html == layout/reftests/bugs/1553571-1-ref.html | load failed: timed out waiting for pending paint count to reach zero (waiting for MozAfterPaint) (waiting for updateCanvasPending)
[task 2020-04-16T01:03:17.522Z] 01:03:17 INFO - REFTEST INFO | Saved log: START file:///Z:/task_1586996919/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html

Comment 1

[Intermittent Failures Robot]

1 failures in 4528 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1630489&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 3

[Dorel Luca [:dluca]]

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=302316943&repo=autoland&lineNumber=11163

Comment 4

[Intermittent Failures Robot]

1 failures in 5488 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1630489&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 5

[Intermittent Failures Robot]

2 failures in 4727 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1630489&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 5211 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1630489&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 8

[Cristina Coroiu [:ccoroiu]]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=324680164&repo=mozilla-central&lineNumber=11799

Comment 9

[Intermittent Failures Robot]

16 failures in 3421 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6
• autoland: 9
• try: 1

Platform breakdown:

• linux1804-64-asan-qr: 7
• linux1804-64-qr: 8
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 10

[Intermittent Failures Robot]

10 failures in 1450 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 3

Platform breakdown:

• linux1804-64-qr: 4
• linux1804-64-asan-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 11

[Intermittent Failures Robot]

4 failures in 525 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan-qr: 2
• linux1804-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 13

[Intermittent Failures Robot]

24 failures in 2956 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• autoland: 16
• try: 1

Platform breakdown:

• linux1804-64-asan-qr: 15
• android-em-7-0-x86_64: 3
• linux1804-64-qr: 3
• linux1804-64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 14

[Intermittent Failures Robot]

25 failures in 3810 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

Repository breakdown:

• autoland: 20
• try: 2
• mozilla-beta: 1
• mozilla-central: 2

Platform breakdown:

• linux1804-64-asan-qr: 16
• linux1804-64-qr: 7
• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 15

[Intermittent Failures Robot]

26 failures in 3488 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 15
• mozilla-central: 10
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 13
  • debug: 13
• linux1804-64-asan-qr: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 16

[Intermittent Failures Robot]

32 failures in 3891 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-central: 8
• try: 2
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 9
• linux1804-64-asan-qr: 23
  • opt: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 17

[Andreea Pavel [:apavel]]

There are 28 total failures in the last 7 days on linux1804-64-asan-qr opt, linux1804-64-qr debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=328524334&repo=mozilla-central&lineNumber=12932

task 2021-02-02T04:27:50.370Z] 04:27:50 INFO - REFTEST TEST-START | layout/reftests/bugs/1553571-1.html == layout/reftests/bugs/1553571-1-ref.html
[task 2021-02-02T04:27:50.371Z] 04:27:50 INFO - REFTEST INFO | SET PREFERENCE pref(image.downscale-during-decode.enabled,true)
[task 2021-02-02T04:27:50.372Z] 04:27:50 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html | 2022 / 2052 (98%)
[task 2021-02-02T04:32:50.390Z] 04:32:50 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/1553571-1.html == layout/reftests/bugs/1553571-1-ref.html | load failed: timed out waiting for pending paint count to reach zero (waiting for MozAfterPaint) (waiting for updateCanvasPending)
[task 2021-02-02T04:32:50.392Z] 04:32:50 INFO - REFTEST INFO | Saved log: START file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.392Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering WaitForTestEnd
[task 2021-02-02T04:32:50.393Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] WaitForTestEnd: Adding listeners
[task 2021-02-02T04:32:50.394Z] 04:32:50 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2021-02-02T04:32:50.394Z] 04:32:50 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2021-02-02T04:32:50.395Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress
[task 2021-02-02T04:32:50.397Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.398Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.398Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.398Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] FlushRendering generated paint for window file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.398Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2021-02-02T04:32:50.398Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2021-02-02T04:32:50.400Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for updateCanvasPending
[task 2021-02-02T04:32:50.401Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress waiting for a MozAfterPaint
[task 2021-02-02T04:32:50.402Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.402Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress updating canvas
[task 2021-02-02T04:32:50.404Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] Webrender enabled, sending update whole canvas for invalidation
[task 2021-02-02T04:32:50.404Z] 04:32:50 INFO - REFTEST INFO | Saved log: Updating entire canvas for invalidation
[task 2021-02-02T04:32:50.405Z] 04:32:50 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2021-02-02T04:32:50.406Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress
[task 2021-02-02T04:32:50.406Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.407Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2021-02-02T04:32:50.408Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2021-02-02T04:32:50.409Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for updateCanvasPending
[task 2021-02-02T04:32:50.409Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress waiting for a MozAfterPaint
[task 2021-02-02T04:32:50.420Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.421Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress waiting for a MozAfterPaint
[task 2021-02-02T04:32:50.424Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.425Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress updating canvas
[task 2021-02-02T04:32:50.425Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] Webrender enabled, sending update whole canvas for invalidation
[task 2021-02-02T04:32:50.426Z] 04:32:50 INFO - REFTEST INFO | Saved log: Updating entire canvas for invalidation
[task 2021-02-02T04:32:50.427Z] 04:32:50 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2021-02-02T04:32:50.427Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress
[task 2021-02-02T04:32:50.428Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.432Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.433Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2021-02-02T04:32:50.433Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2021-02-02T04:32:50.434Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for updateCanvasPending
[task 2021-02-02T04:32:50.435Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress waiting for a MozAfterPaint
[task 2021-02-02T04:32:50.435Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1553571-1.html
[task 2021-02-02T04:32:50.438Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] HandlePendingTasksAfterMakeProgress updating canvas
[task 2021-02-02T04:32:50.439Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] Webrender enabled, sending update whole canvas for invalidation
[task 2021-02-02T04:32:50.440Z] 04:32:50 INFO - REFTEST INFO | Saved log: Updating entire canvas for invalidation
[task 2021-02-02T04:32:50.441Z] 04:32:50 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2021-02-02T04:32:50.444Z] 04:32:50 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress

Daniel, can you assign someone to take a look?

Comment 18

[Timothy Nikkel (:tnikkel)]

Attachment: Bug 1630489. Skip layout/reftests/bugs/1553571-1.html on debug and asan builds with webrender. r?dholbert

To accurately test the condition we need to tweak a transform every 74 ms. This leads to problems on platforms that can't complete a full paint cycle through the reftest harness (which consists of two paints, the one for the screen and then one to update the reftest canvas). This only used to affect android debug builds severely but seems to have gotten worse on linux debug and asan builds.

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/mozilla-central/rev/0f67581b48c3
Skip layout/reftests/bugs/1553571-1.html on debug and asan builds with webrender. r=dholbert

Comment 20

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/0f67581b48c3

Comment 21

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/0ed0d98d5d14

Comment 22

[Intermittent Failures Robot]

6 failures in 3966 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 1
• mozilla-central: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-qr: 3
  • debug: 3
• linux1804-64-asan-qr: 2
  • opt: 2
• android-em-7-0-x86_64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1630489&startday=2021-02-01&endday=2021-02-07&tree=all