Closed Bug 1464302 Opened 5 years ago Closed 5 months ago

Intermittent TEST-UNEXPECTED-FAIL | css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html

Categories

(Testing :: web-platform-tests, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell unknown])

Filed by: csabou [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=180127052&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/HowR8IlaQEOHGNkLbTnNnQ/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/HowR8IlaQEOHGNkLbTnNnQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2018-05-25T00:08:07.730Z] 00:08:07     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html
[task 2018-05-25T00:08:07.734Z] 00:08:07     INFO - PID 13358 | 1527206887730	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-05-25T00:08:07.942Z] 00:08:07     INFO - TEST-UNEXPECTED-PASS | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-05-25T00:08:07.942Z] 00:08:07     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAlgAAAJYCAYAAAC+ZpjcAAALL0lEQVR4nO3aO46DQBRFwV669+gFzQTzSZvgWNBPVajTC5IDjpDXFwAAqXX3AwAATCOwAABiAgsAICawAABiAgsAICawAABiAgsAILYNrLWunnXp/Hm/3+mxe/YuAExyW2AJN7sCC4CpxgWWcDtzFwAmEVgC6xG7ADDJ/k/ur9elsy5e/zcWWHYFFgBDCSzh9ohdAJjktsASbj9OCyGBBQB74wLrtHA7LYQEFgDsCSxfxgQWAMS2gfWxF6rAOnJXYAHAnsASbgILAGK3BZZw+/0BDgusT+0CwCTjAuu0cDsthAQWAOwJLF/GBBYAxATW0MA6LdwAYBKBJdwEFgDEBJbAesYuAAwisATWM3YBYBCBNXRXYAHAfQSW3WeEGwAM4g0HABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAsW/BrNP/X8CJrgAAAABJRU5ErkJggg==
[task 2018-05-25T00:08:07.943Z] 00:08:07     INFO - REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAlgAAAJYCAYAAAC+ZpjcAAALL0lEQVR4nO3aO46DQBRFwV669+gFzQTzSZvgWNBPVajTC5IDjpDXFwAAqXX3AwAATCOwAABiAgsAICawAABiAgsAICawAABiAgsAILYNrLWunnXp/Hm/3+mxe/YuAExyW2AJN7sCC4CpxgWWcDtzFwAmEVgC6xG7ADDJ/k/ur9elsy5e/zcWWHYFFgBDCSzh9ohdAJjktsASbj9OCyGBBQB74wLrtHA7LYQEFgDsCSxfxgQWAMS2gfWxF6rAOnJXYAHAnsASbgILAGK3BZZw+/0BDgusT+0CwCTjAuu0cDsthAQWAOwJLF/GBBYAxATW0MA6LdwAYBKBJdwEFgDEBJbAesYuAAwisATWM3YBYBCBNXRXYAHAfQSW3WeEGwAM4g0HABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAsW/BrNP/X8CJrgAAAABJRU5ErkJggg==
[task 2018-05-25T00:08:07.943Z] 00:08:07     INFO - TEST-INFO expected FAIL | took 208ms
[task 2018-05-25T00:08:08.047Z] 00:08:08     INFO - PID 13358 | 1527206888043	Marionette	INFO	Stopped listening on port 2828
[task 2018-05-25T00:08:08.231Z] 00:08:08     INFO - PID 13358 | *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping
[task 2018-05-25T00:08:08.554Z] 00:08:08     INFO - Browser exited with return code 0
[task 2018-05-25T00:08:08.556Z] 00:08:08  WARNING - u'runner_teardown': ()
[task 2018-05-25T00:08:08.577Z] 00:08:08     INFO - Setting up ssl
[task 2018-05-25T00:08:08.613Z] 00:08:08     INFO - certutil | 
[task 2018-05-25T00:08:08.649Z] 00:08:08     INFO - certutil | 
[task 2018-05-25T00:08:08.677Z] 00:08:08     INFO - certutil | 
[task 2018-05-25T00:08:08.678Z] 00:08:08     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-05-25T00:08:08.678Z] 00:08:08     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-05-25T00:08:08.679Z] 00:08:08     INFO - 
[task 2018-05-25T00:08:08.680Z] 00:08:08     INFO - web-platform-tests                                           CT,, 
[task 2018-05-25T00:08:08.680Z] 00:08:08     INFO - 
[task 2018-05-25T00:08:08.708Z] 00:08:08     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpu11NUU.mozrunner
[task 2018-05-25T00:08:08.729Z] 00:08:08     INFO - Starting runner
Per https://bugzilla.mozilla.org/show_bug.cgi?id=1463827#c5
Component: Layout → web-platform-tests
Product: Core → Testing
This has a failure rate of 29 occurences in the last 7 days, the majority on linux64-qr opt and few on debug.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=182747216&repo=mozilla-inbound&lineNumber=11666

[task 2018-06-10T10:12:16.490Z] 10:12:16     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html
[task 2018-06-10T10:12:16.506Z] 10:12:16     INFO - PID 12849 | 1528625536490	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-06-10T10:12:16.659Z] 10:12:16     INFO - TEST-UNEXPECTED-PASS | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html


[task 2018-06-10T10:12:16.661Z] 10:12:16     INFO - TEST-INFO expected FAIL | took 164ms
[task 2018-06-10T10:12:16.744Z] 10:12:16     INFO - PID 12849 | 1528625536737	Marionette	INFO	Stopped listening on port 2828
[task 2018-06-10T10:12:17.270Z] 10:12:17     INFO - Browser exited with return code 0
[task 2018-06-10T10:12:17.271Z] 10:12:17  WARNING - u'runner_teardown': ()
[task 2018-06-10T10:12:17.288Z] 10:12:17     INFO - Setting up ssl
[task 2018-06-10T10:12:17.316Z] 10:12:17     INFO - certutil | 
[task 2018-06-10T10:12:17.352Z] 10:12:17     INFO - certutil | 
[task 2018-06-10T10:12:17.368Z] 10:12:17     INFO - certutil | 
[task 2018-06-10T10:12:17.369Z] 10:12:17     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-06-10T10:12:17.369Z] 10:12:17     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-06-10T10:12:17.369Z] 10:12:17     INFO - 
[task 2018-06-10T10:12:17.369Z] 10:12:17     INFO - web-platform-tests                                           CT,, 
[task 2018-06-10T10:12:17.370Z] 10:12:17     INFO - 
[task 2018-06-10T10:12:17.390Z] 10:12:17     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpgUcZxj.mozrunner
[task 2018-06-10T10:12:17.406Z] 10:12:17     INFO - Starting runner
[task 2018-06-10T10:12:18.149Z] 10:12:18     INFO - PID 13597 | ATTENTION: default value of option force_s3tc_enable overridden by environment.
[task 2018-06-10T10:12:21.735Z] 10:12:21     INFO - PID 13597 | 1528625541734	Marionette	INFO	Listening on port 2828

:kats since you've worked on this, do you know a fix for it?
Flags: needinfo?(bugmail)
(In reply to Andreea Pavel [:apavel] from comment #5)
> :kats since you've worked on this, do you know a fix for it?

No, as far as I can tell this is a problem with the wpt reftest harness. The exact same test is 100% pass in the regular reftest harness, but only intermittently passes in the web-platform-test harness (see bug 1463827 comment 5). Redirecting needinfo to :jgraham since I believe he owns the wpt reftest harness.

If this intermittent gets too frequent I'm fine with disabling the test since it's obviously providing zero value, we already have the same test in the reftest suite.
Flags: needinfo?(bugmail) → needinfo?(james)
https://hg.mozilla.org/mozilla-central/rev/dd958f1110d6 flipped the expectation from FAIL to PASS, so now we're getting TEST-UNEXPECTED-FAIL instead of TEST-UNEXPECTED-PASS. It's still intermittent.
Summary: Intermittent TEST-UNEXPECTED-PASS | css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing → Intermittent TEST-UNEXPECTED-FAIL | css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing
This bug has failed 30 times in the last 7 days only on Linux and opt build type.
Link to a recent log: https://treeherder.mozilla.org/logviewer.html#?job_id=197715344&repo=mozilla-central&lineNumber=11635
Part of that log:
[task 2018-09-05T22:57:09.999Z] 22:57:09     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-png-002p.html
[task 2018-09-05T22:57:10.000Z] 22:57:10     INFO - PID 14531 | 1536188229997	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-png-002p.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-png-002-ref.html
[task 2018-09-05T22:57:10.058Z] 22:57:10     INFO - TEST-PASS | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-png-002p.html | took 59ms
[task 2018-09-05T22:57:10.058Z] 22:57:10     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html
[task 2018-09-05T22:57:10.062Z] 22:57:10     INFO - PID 14531 | 1536188230056	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-09-05T22:57:10.220Z] 22:57:10     INFO - PID 14531 | 1536188230215	Marionette	INFO	Found 860 pixels different, maximum difference per channel 255
[task 2018-09-05T22:57:10.249Z] 22:57:10     INFO - TEST-UNEXPECTED-FAIL | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html | Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001e.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-09-05T22:57:10.249Z] 22:57:10     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAlgAAAJYCAYAAAC+ZpjcAAALKklEQVR4nO3aMW7DMBQFQR7dd/SBkipppWIFkR8zBttngw238PoBACC13v4BAADTCCwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCIXQbWWnfPunX+fL/f9Jy6+9T9nrYLAJO8FljC7cz7FVgAcG1cYJ0Wbqfdg8ACgGsCS2BtsQsAk1y/cJ/PrbNufv6/+LAAEFjP7gLAJALL7ha7ADDJa4El3OwKLACmGhdYwu3MXQCYRGAJrC12AWCSyxfuqT93Cyy7AguAqQSW3T12AWCQ1wJLuNkVWABMNS6whNuhuwAwiMASWHvsAsAgAktg7bELAIMILOG2xy4ADCKwBNYeuwAwiMASWHvsAsAgAktg7bELAIMILIG1xy4ADOKFAwCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgJjAAgCICSwAgNgvbpdK8Ac9mIYAAAAASUVORK5CYII=
[task 2018-09-05T22:57:10.249Z] 22:57:10     INFO - REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAlgAAAJYCAYAAAC+ZpjcAAALL0lEQVR4nO3aO46DQBRFwV669+gFzQTzSZvgWNBPVajTC5IDjpDXFwAAqXX3AwAATCOwAABiAgsAICawAABiAgsAICawAABiAgsAILYNrLWunnXp/Hm/3+mxe/YuAExyW2AJN7sCC4CpxgWWcDtzFwAmEVgC6xG7ADDJ/k/ur9elsy5e/zcWWHYFFgBDCSzh9ohdAJjktsASbj9OCyGBBQB74wLrtHA7LYQEFgDsCSxfxgQWAMS2gfWxF6rAOnJXYAHAnsASbgILAGK3BZZw+/0BDgusT+0CwCTjAuu0cDsthAQWAOwJLF/GBBYAxATW0MA6LdwAYBKBJdwEFgDEBJbAesYuAAwisATWM3YBYBCBNXRXYAHAfQSW3WeEGwAM4g0HABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAMYEFABATWAAAsW/BrNP/X8CJrgAAAABJRU5ErkJggg==
[task 2018-09-05T22:57:10.250Z] 22:57:10     INFO - TEST-INFO took 186ms
[task 2018-09-05T22:57:10.352Z] 22:57:10     INFO - PID 14531 | 1536188230344	Marionette	INFO	Stopped listening on port 2828
[task 2018-09-05T22:57:10.369Z] 22:57:10     INFO - PID 14531 | JavaScript error: resource://activity-stream/lib/TopSitesFeed.jsm, line 86: TypeError: setting getter-only property "_currentSearchHostname"
[task 2018-09-05T22:57:10.498Z] 22:57:10     INFO - PID 14531 | [Parent 14531, Gecko_IOThread] WARNING: pipe error (91): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 356
[task 2018-09-05T22:57:10.499Z] 22:57:10     INFO - PID 14531 | [Parent 14531, Gecko_IOThread] WARNING: pipe error (99): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 356
[task 2018-09-05T22:57:10.910Z] 22:57:10     INFO - Browser exited with return code 0
[task 2018-09-05T22:57:10.912Z] 22:57:10  WARNING - u'runner_teardown': ()
[task 2018-09-05T22:57:10.929Z] 22:57:10     INFO - Setting up ssl
[task 2018-09-05T22:57:10.965Z] 22:57:10     INFO - certutil | 
[task 2018-09-05T22:57:11.002Z] 22:57:11     INFO - certutil | 
[task 2018-09-05T22:57:11.024Z] 22:57:11     INFO - certutil | 
[task 2018-09-05T22:57:11.024Z] 22:57:11     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-09-05T22:57:11.024Z] 22:57:11     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-09-05T22:57:11.025Z] 22:57:11     INFO - 
[task 2018-09-05T22:57:11.025Z] 22:57:11     INFO - web-platform-tests                                           CT,, 
[task 2018-09-05T22:57:11.026Z] 22:57:11     INFO - 
[task 2018-09-05T22:57:11.055Z] 22:57:11     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpFOys9Q.mozrunner
[task 2018-09-05T22:57:11.076Z] 22:57:11     INFO - Starting runner
[task 2018-09-05T22:57:13.908Z] 22:57:13     INFO - PID 15332 | 1536188233895	Marionette	INFO	Listening on port 2828
[task 2018-09-05T22:57:16.416Z] 22:57:16     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001i.html
[task 2018-09-05T22:57:17.400Z] 22:57:17     INFO - PID 15332 | 1536188237396	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001i.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-09-05T22:57:18.145Z] 22:57:18     INFO - TEST-PASS | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001i.html | took 1730ms
[task 2018-09-05T22:57:18.147Z] 22:57:18     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001o.html
[task 2018-09-05T22:57:18.155Z] 22:57:18     INFO - PID 15332 | 1536188238149	Marionette	INFO	Testing http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001o.html == http://web-platform.test:8000/css/vendor-imports/mozilla/mozilla-central-reftests/images3/object-position-svg-001-ref.html
[task 2018-09-05T22:57:18.557Z] 22:57:18     INFO - PID 15332 | 1536188238546	Marionette	INFO	Found 860 pixels different, maximum difference per channel 255

:jgraham do you haeve any updates for this bug?
Whiteboard: [stockwell needswork]
This seems to be a permafail these days.
Flags: needinfo?(james)
Severity: normal → S3

No failures in 4 years (and we don't have the test annotated as skipped/random/failing etc.) Seems like we can close this as WORKSFOME.

Status: NEW → RESOLVED
Closed: 5 months ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.