1483668 - Intermittent test-verify /css/css-contain/contain-size-00*.html | Testing http://web-platform.test:8000/css/css-contain/contain-size-00*.html == http://web-platform.test:8000/css/css-contain/reference/contain-size-00*-ref.html

Status: RESOLVED INCOMPLETE

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=194121423&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/en4NAL7hQOKQgBdgsABlXg/runs/0/artifacts/public/logs/live_backing.log

10:18:35     INFO - 
10:18:35     INFO - Application command: /Users/cltbld/tasks/task_1534353018/build/application/Firefox Nightly.app/Contents/MacOS/firefox --marionette about:blank -foreground -profile /var/folders/m2/3rtwd8456cx56vmft7sq9xnh00000w/T/tmp5fxN28.mozrunner
10:18:35     INFO - Starting runner
10:18:37     INFO - PID 2221 | 1534353517150	Marionette	INFO	Listening on port 2828
10:18:37     INFO - PID 2221 | 1534353517258	Marionette	DEBUG	[2147483649] Frame script loaded
10:18:37     INFO - PID 2221 | 1534353517273	Marionette	DEBUG	[2147483649] Frame script registered
10:18:37     INFO - PID 2221 | 1534353517311	Marionette	DEBUG	[2147483649] Received DOM event beforeunload for about:blank
10:18:37     INFO - PID 2221 | 1534353517345	Marionette	DEBUG	[2147483649] Received DOM event pagehide for about:blank
10:18:37     INFO - PID 2221 | 1534353517346	Marionette	DEBUG	[2147483649] Received DOM event unload for about:blank
10:18:37     INFO - PID 2221 | 1534353517363	Marionette	DEBUG	[2147483649] Received DOM event DOMContentLoaded for http://web-platform.test:8000/testharness_runner.html
10:18:37     INFO - PID 2221 | 1534353517433	Marionette	DEBUG	[2147483649] Received DOM event pageshow for http://web-platform.test:8000/testharness_runner.html
10:18:37     INFO - TEST-START | /css/css-contain/contain-size-004.html
10:18:37     INFO - Run 0/10
10:18:37     INFO - PID 2221 | 1534353517929	Marionette	DEBUG	[6442450945] Frame script loaded
10:18:37     INFO - PID 2221 | 1534353517930	Marionette	DEBUG	[6442450945] Frame script registered
10:18:37     INFO - PID 2221 | 1534353517934	Marionette	INFO	Testing http://web-platform.test:8000/css/css-contain/contain-size-004.html == http://web-platform.test:8000/css/css-contain/reference/contain-size-004-ref.html
10:18:37     INFO - PID 2221 | 1534353517960	Marionette	DEBUG	[6442450945] Waiting for page load of http://web-platform.test:8000/css/css-contain/reference/contain-size-004-ref.html
10:18:37     INFO - PID 2221 | 1534353517981	Marionette	DEBUG	[6442450945] flushRendering false
10:18:38     INFO - PID 2221 | 1534353517998	Marionette	DEBUG	[6442450945] Waiting for page load of http://web-platform.test:8000/css/css-contain/contain-size-004.html
10:18:38     INFO - PID 2221 | 1534353518008	Marionette	DEBUG	[6442450945] flushRendering true
10:18:38     INFO - PID 2221 | 1534353518018	Marionette	INFO	Found 9 pixels different, maximum difference per channel 16
10:18:38     INFO - TEST-UNEXPECTED-FAIL | /css/css-contain/contain-size-004.html | Testing http://web-platform.test:8000/css/css-contain/contain-size-004.html == http://web-platform.test:8000/css/css-contain/reference/contain-size-004-ref.html

Comment 1

[Daniel Holbert [:dholbert]]

This will be addressed when we receive the test-updates from https://github.com/web-platform-tests/wpt/issues/12362

In the meantime, this isn't intermittent - it's a perma-fail, except this test only gets run when there are changes to it (this test never runs on mac otherwise right now -- see bug 1481723), which mean it won't be run on subsequent treeherder cycles (until it's next touched which will likely be from pulling in https://github.com/web-platform-tests/wpt/issues/12362 )  So, this shouldn't cause sheriff pain in the meantime, fortunately.

Comment 2

[Intermittent Failures Robot]

26 failures in 527 pushes (0.049 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 15
* autoland: 11

Platform breakdown:
* windows7-32: 6
* macosx64-nightly: 1
* windows10-64-msvc: 1
* windows7-32-msvc: 1
* windows10-64-ccov: 1
* windows10-64: 9
* osx-10-10: 5
* windows7-32-nightly: 1
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1483668&startday=2018-08-16&endday=2018-08-16&tree=all

Comment 3

[Intermittent Failures Robot]

33 failures in 2672 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 15
* autoland: 10
* mozilla-inbound: 8

Platform breakdown:
* windows7-32-msvc: 1
* windows7-32: 9
* windows10-64-ccov: 1
* windows7-32-nightly: 1
* macosx64-nightly: 1
* windows10-64: 11
* windows10-64-nightly: 1
* windows10-64-msvc: 1
* osx-10-10: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1483668&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 4

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 5

[Intermittent Failures Robot]

2 failures in 2684 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2

Platform breakdown:
* osx-10-10: 1
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1483668&startday=2018-09-10&endday=2018-09-16&tree=all

Comment 6

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup