1597608 - Intermittent Tier 2 text/1463020-letter-spacing-text-transform-1.html == text/1463020-letter-spacing-text-transform-1-ref.html | image comparison, max difference: 128, number of differing pixels: 234

Status: RESOLVED INCOMPLETE

(Core :: Graphics: WebRender, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=276914016&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZhuuluOLS_iHTupGIHflGQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZhuuluOLS_iHTupGIHflGQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-11-19T04:47:41.803Z] 04:47:41 INFO - REFTEST TEST-START | http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1.html == http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1-ref.html
[task 2019-11-19T04:47:41.803Z] 04:47:41 INFO - REFTEST TEST-LOAD | http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1.html | 537 / 1944 (27%)
[task 2019-11-19T04:47:41.803Z] 04:47:41 INFO - REFTEST TEST-LOAD | http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1-ref.html | 537 / 1944 (27%)
[task 2019-11-19T04:47:41.803Z] 04:47:41 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (128, 234) <= (128, 233)
[task 2019-11-19T04:47:41.803Z] 04:47:41 WARNING - REFTEST TEST-UNEXPECTED-FAIL | http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1.html == http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1-ref.html | image comparison, max difference: 128, number of differing pixels: 234
[task 2019-11-19T04:47:41.815Z] 04:47:41 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyA...
[task 2019-11-19T04:47:41.816Z] 04:47:41 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEU...
[task 2019-11-19T04:47:41.816Z] 04:47:41 INFO - REFTEST TEST-END | http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1.html == http://10.7.205.211:8854/tests/layout/reftests/text/1463020-letter-spacing-text-transform-1-ref.html

Comment 1

[Cristina Coroiu [:ccoroiu]]

Started retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Android%2C8.0%2CPixel2%2CQuantumRender%2Copt%2CReftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-8%2CR%28R8%29&tochange=8ae9d7dc86f2e723b73d3b7cdc1cea4c821ad9f0&fromchange=fdd07df83c87f12725f4b97c80e644fd11673977&selectedJob=277552874

Comment 2

[Andrei Ciure[:aciure]]

Retriggered:

https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&selectedJob=276955852&resultStatus=superseded%2Ctestfailed%2Cbusted%2Cexception%2Csuccess%2Cretry%2Cusercancel%2Crunning%2Cpending%2Crunnable&searchStr=android%2C8.0%2Cpixel2%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-8%2Cr%28r8%29&tochange=f8aefd7e35e230dda972a06d2dca628dcd5513de&fromchange=4f123ce2cc07772d932aae792a39a38f3ce765fa

All the retriggers and backfills turned out as superseded. This only happened for Android tests.

jamher: can you take a look?

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

:tomprince, do you know why we supercede all these jobs? it makes it impossible to come in after the fact and collect data.

Comment 4

[Intermittent Failures Robot]

33 failures in 5444 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 23
• mozilla-central: 9
• mozilla-inbound: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 32
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-11-18&endday=2019-11-24&tree=all

Comment 5

[Natalia Csoregi [:nataliaCs]]

Update:
There have been 34 failures within the last 7 days, all of them on Android 8.0 Pixel2 QuantumRender opt/debug.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=278861397&repo=autoland&lineNumber=5101

Comment 6

[Intermittent Failures Robot]

32 failures in 4331 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #25 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• autoland: 23

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 32

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-11-25&endday=2019-12-01&tree=all

Comment 7

[Daniel Holbert [:dholbert]]

all of them on Android 8.0 Pixel2 QuantumRender opt/debug.

Reclassifying as WebRender bug.

We should probably just add a fuzzy-if(webRender&&Android,...) annotation to the test. The failure is a subtle antialiasing difference & isn't really noticeable to the human eye, so it's not particularly concerning.

Comment 8

[Intermittent Failures Robot]

1 failures in 5144 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-12-02&endday=2019-12-08&tree=all

Comment 9

[Intermittent Failures Robot]

12 failures in 4582 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 10

[Intermittent Failures Robot]

9 failures in 1365 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 3
• try: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-12-23&endday=2019-12-29&tree=all

Comment 11

[Intermittent Failures Robot]

8 failures in 1862 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 3

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2019-12-30&endday=2020-01-05&tree=all

Comment 12

[Intermittent Failures Robot]

4 failures in 4472 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1597608&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 14

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.