1475847 - Intermittent svg/text-gradient-04.svg == svg/text-gradient-04-ref.svg | image comparison, max difference: 255, number of differing pixels: 240

Status: RESOLVED INCOMPLETE

(Core :: SVG, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=188238521&repo=autoland

https://queue.taskcluster.net/v1/task/YZYOMOPIR_y6llDtBiA7rA/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/YZYOMOPIR_y6llDtBiA7rA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

05:21:34     INFO - REFTEST TEST-START | file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04.svg == file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04-ref.svg
05:21:34     INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04.svg | 352 / 444 (79%)
05:21:34     INFO - ++DOMWINDOW == 175 (0x122ed5800) [pid = 756] [serial = 850] [outer = 0x10ed3b600]
05:21:34     INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04-ref.svg | 352 / 444 (79%)
05:21:34     INFO - ++DOMWINDOW == 176 (0x122fed400) [pid = 756] [serial = 851] [outer = 0x10ed3b600]
05:21:34     INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04.svg == file:///Users/cltbld/tasks/task_1531656952/build/tests/reftest/tests/layout/reftests/svg/text-gradient-04-ref.svg | image comparison, max difference: 255, number of differing pixels: 240

Comment 1

[Intermittent Failures Robot]

2 failures in 623 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-07-09&endday=2018-07-15&tree=trunk

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

this seems to fail in test-verify mode on both the original push and the previous push:
https://treeherder.mozilla.org/#/jobs?repo=autoland&filter-searchStr=osx%20-bf&tochange=fb68d406a87d519d11e0bf1c20f10185e5d28dba&fromchange=cf60869ce62a7151fcb01350e88100442cf77b52

we should bisect this back

Comment 3

[Intermittent Failures Robot]

15 failures in 653 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 9
* mozilla-central: 5
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 7
* windows7-32: 3
* windows10-64-ccov: 3
* windows7-32-msvc: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-07-16&endday=2018-07-22&tree=trunk

Comment 4

[Intermittent Failures Robot]

9 failures in 760 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 4
* autoland: 4
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 5
* windows10-64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 5

[meck93]

Dear Reader,

We are a joint research team from the University of Zurich, Switzerland* and Mozilla** and are building a tool to automatically recognize the type of an intermittent-failure, such as the one here.

By automatically recognizing the type of failure, the tool should provide a starting point for the bug fixing process. To evaluate and improve the tool, we kindly ask your feedback.
    
Tool Result - this intermittent-failure is most likely affected by a:
Assertion Failure (test vs. reference value): This includes test failures in which a (pre-) defined value was not met or the value that the test produced lies outside of the range of acceptable values. This often occurs when running reference tests (e.g. comparing images, audio, etc.). Also, this includes wrong assertion statements only leading to intermittent- and not permanent-failures.

Feedback: 
1. Did the tool correctly recognize the type of intermittent-failure? (please also explain why or why not)
2. Did the information from the tool help your analysis, the bug fixing process, or anything in the process? (please also let us know how the tool was useful and/or what would improve the tool's usefulness for you)

Thank you very much for your help! 
*Moritz, Fabio and Alberto (http://www.ifi.uzh.ch/en/zest/team.html)
**Marco Castellucio (https://marco-c.github.io/)

Comment 6

[Intermittent Failures Robot]

3 failures in 2568 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* autoland: 2

Platform breakdown:
* osx-10-10: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 2545 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-08-27&endday=2018-09-02&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 2667 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 10

[Ryan VanderMeulen [:RyanVM]]

Wrong tab.

Comment 11

[Intermittent Failures Robot]

2 failures in 2773 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* try: 1

Platform breakdown:
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-09-24&endday=2018-09-30&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 2708 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 13

[Intermittent Failures Robot]

3 failures in 2740 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1475847&startday=2018-10-08&endday=2018-10-14&tree=all

Comment 14

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup