1480068 - Intermittent TEST-UNEXPECTED-PASS | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.htm

Status: RESOLVED INCOMPLETE

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=191261334&repo=mozilla-central

https://queue.taskcluster.net/v1/task/Il0JG-yFSPe9RWxinm9cDg/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Il0JG-yFSPe9RWxinm9cDg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1&only_show_unexpected=1

Comment 1

[Daniel Holbert [:dholbert]]

Looks like the "normal reftest harness" version of this testcase is expected to pass on webrender configurations:
https://dxr.mozilla.org/mozilla-central/rev/085cdfb90903d4985f0de1dc7786522d9fb45596/layout/reftests/w3c-css/submitted/images3/reftest.list#184


However, in the WPT reftest harness version, it's annotated as failing on all configurations:
https://dxr.mozilla.org/mozilla-central/rev/085cdfb90903d4985f0de1dc7786522d9fb45596/testing/web-platform/meta/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html.ini


This "unexpected pass" is a case where the wpt harness version is passing on a webrender configuration (and per the "normal reftest harness" annotations for this test, it seems like it should indeed be expected to pass in that configuration).

If the WPT test normally fails even under webrender (and only sporadically passes), as seems to be the case here, I would bet it has something to do with the WPT harness snapshotting race condition discussed in bug 1471583.

Comment 2

[Intermittent Failures Robot]

9 failures in 2579 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 2
* try: 7

Platform breakdown:
* linux64-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 3

[Intermittent Failures Robot]

10 failures in 2672 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 3
* mozilla-beta: 2
* mozilla-central: 5

Platform breakdown:
* linux64-qr: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 4

[Intermittent Failures Robot]

13 failures in 2568 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 10
* try: 3

Platform breakdown:
* linux64-qr: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 5

[Intermittent Failures Robot]

9 failures in 2545 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 5
* mozilla-release: 1
* try: 3

Platform breakdown:
* linux64-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-08-27&endday=2018-09-02&tree=all

Comment 6

[Intermittent Failures Robot]

7 failures in 2667 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 4
* mozilla-beta: 1
* try: 2

Platform breakdown:
* linux64-qr: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 7

[Intermittent Failures Robot]

10 failures in 2684 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 3
* try: 1
* mozilla-central: 6

Platform breakdown:
* linux64-qr: 9
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-09-10&endday=2018-09-16&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 2902 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-09-17&endday=2018-09-23&tree=all

Comment 9

[Intermittent Failures Robot]

4 failures in 2773 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 4

Platform breakdown:
* linux64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-09-24&endday=2018-09-30&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 2708 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 3

Platform breakdown:
* linux64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 11

[Intermittent Failures Robot]

3 failures in 2759 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-release: 2
* mozilla-beta: 1

Platform breakdown:
* linux64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 2978 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480068&startday=2018-10-29&endday=2018-11-04&tree=all

Comment 13

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup