1500226 - Intermittent TEST-UNEXPECTED-PASS | /css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht | Testing http://web-platform.test:8000/css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht

Status: RESOLVED DUPLICATE of bug 1568389

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=206396920&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/N09vUxgJSli_YHagKISmng/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/N09vUxgJSli_YHagKISmng/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

16:50:28     INFO - TEST-START | /css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht
16:50:28     INFO - PID 5504 | 1539881428701	Marionette	INFO	Testing http://web-platform.test:8000/css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht == http://web-platform.test:8000/css/reference/ref-filled-green-100px-square.xht
16:50:28     INFO - PID 5504 | ++DOMWINDOW == 69 (14D96000) [pid = 4592] [serial = 69] [outer = 10F218D0]
16:50:28     INFO - PID 5504 | ++DOCSHELL 14D96C00 == 20 [pid = 4592] [id = {6dd13d0b-fe65-416d-99bf-2c8f5bf22477}]
16:50:28     INFO - PID 5504 | [Child 4592, Main Thread] WARNING: NS_ENSURE_TRUE(browserChrome) failed: file z:/build/build/src/docshell/base/nsDocShell.cpp, line 12726
16:50:28     INFO - PID 5504 | [Child 4592, Main Thread] WARNING: NS_ENSURE_TRUE(browserChrome) failed: file z:/build/build/src/docshell/base/nsDocShell.cpp, line 12726
16:50:28     INFO - PID 5504 | [Child 4592, Main Thread] WARNING: NS_ENSURE_TRUE(browserChrome) failed: file z:/build/build/src/docshell/base/nsDocShell.cpp, line 12726
16:50:28     INFO - PID 5504 | ++DOMWINDOW == 70 (10F22E30) [pid = 4592] [serial = 70] [outer = 00000000]
16:50:28     INFO - PID 5504 | ++DOMWINDOW == 71 (14D97400) [pid = 4592] [serial = 71] [outer = 10F22E30]
16:50:28     INFO - PID 5504 | [Child 4592, Main Thread] WARNING: Listener is not retargetable: file z:/build/build/src/netwerk/protocol/http/HttpChannelChild.cpp, line 3710
16:50:28     INFO - PID 5504 | [Child 4592, Main Thread] WARNING: Failed to retarget HTML data delivery to the parser thread.: file z:/build/build/src/parser/html/nsHtml5StreamParser.cpp, line 1023
16:50:28     INFO - TEST-UNEXPECTED-PASS | /css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht | Testing http://web-platform.test:8000/css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht == http://web-platform.test:8000/css/reference/ref-filled-green-100px-square.xht

Comment 1

[Intermittent Failures Robot]

19 failures in 501 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 2
* mozilla-inbound: 2
* autoland: 15

Platform breakdown:
* windows10-64-devedition: 1
* windows10-64: 13
* windows7-32: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-19&endday=2018-10-19&tree=all

Comment 2

[Andrei Ciure[:aciure]]

Retriggered:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&selectedJob=206417893&searchStr=3dda9026bce22d5cfda238026517e80fd15d2529&tochange=11f359e1b03813e834e3c34c9d13aa93564d7999&fromchange=2da6504c901e9474566aa1663d907bd58bed9edb

Comment 3

[Intermittent Failures Robot]

38 failures in 2759 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-inbound: 9
* autoland: 21
* mozilla-central: 3
* try: 5

Platform breakdown:
* windows7-32: 15
* windows10-64: 20
* windows10-64-devedition: 2
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 4

[Intermittent Failures Robot]

26 failures in 430 pushes (0.06 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 7
* mozilla-central: 1
* try: 1
* autoland: 17

Platform breakdown:
* windows7-32: 13
* windows10-64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-22&endday=2018-10-22&tree=all

Comment 5

[Intermittent Failures Robot]

21 failures in 607 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 16
* mozilla-inbound: 5

Platform breakdown:
* windows7-32: 12
* windows10-64: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-23&endday=2018-10-23&tree=all

Comment 6

[Intermittent Failures Robot]

34 failures in 496 pushes (0.069 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-beta: 1
* autoland: 15
* mozilla-inbound: 16
* mozilla-central: 2

Platform breakdown:
* windows7-32: 14
* windows10-64: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-24&endday=2018-10-24&tree=all

Comment 7

[Intermittent Failures Robot]

21 failures in 448 pushes (0.047 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 6
* autoland: 15

Platform breakdown:
* windows7-32: 9
* windows10-64: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-25&endday=2018-10-25&tree=all

Comment 8

[Intermittent Failures Robot]

16 failures in 411 pushes (0.039 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-beta: 1
* autoland: 10
* mozilla-inbound: 4
* mozilla-central: 1

Platform breakdown:
* windows10-64-devedition: 1
* windows10-64: 8
* windows7-32: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-26&endday=2018-10-26&tree=all

Comment 9

[Cristina Coroiu [:ccoroiu]]

I was looking at this bug and in the wpt manifest testing/web-platform/meta/css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht.ini I found this:

[abs-pos-non-replaced-icb-vrl-020.xht]
  expected:
    if debug and not webrender and e10s and (os == "win") and (version == "6.1.7601") and (processor == "x86") and (bits == 32): FAIL
    if not debug and not webrender and e10s and (os == "win") and (version == "6.1.7601") and (processor == "x86") and (bits == 32): FAIL
    if debug and not webrender and e10s and (os == "win") and (version == "10.0.15063") and (processor == "x86_64") and (bits == 64): FAIL
    if not debug and not webrender and e10s and (os == "win") and (version == "10.0.15063") and (processor == "x86_64") and (bits == 64): FAIL

This is failing for windows10-64, windows7-32 debug, opt and pgo. 

Since this is expected to fail, a disable is still needed? How can we proceed in this case?

:jmaher :gbrown can you please take a look?

Comment 10

[Cristina Coroiu [:ccoroiu]]

:bhackett could you please take a look? it seems that this started with your push, please see Comment 2

Comment 11

[Cristina Coroiu [:ccoroiu]]

Added a few re-triggers and the issue is older:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&searchStr=windows%2C10%2Cx64%2Cdebug%2Cweb%2Cplatform%2Ctests%2Cwith%2Ce10s%2Ctest-windows10-64%2Fdebug-web-platform-tests-reftests-e10s-6%2Cw-e10s%28wr6%29&tochange=11f359e1b03813e834e3c34c9d13aa93564d7999&group_state=expanded&fromchange=ee8274a9b6c09241f0da9b6ed3b83a95b8091574&selectedJob=206396964

Comment 12

[Brian Hackett [Laid off!]]

(In reply to Cristina Coroiu [:ccoroiu] from comment #10)
> :bhackett could you please take a look? it seems that this started with your
> push, please see Comment 2

What am I supposed to be looking at in comment 2?  AFAICT there are Wr6 failures for pushes both before and after the ones I made in this range.

Comment 13

[Brian Hackett [Laid off!]]

(In reply to Brian Hackett (:bhackett) from comment #12)
> (In reply to Cristina Coroiu [:ccoroiu] from comment #10)
> > :bhackett could you please take a look? it seems that this started with your
> > push, please see Comment 2
> 
> What am I supposed to be looking at in comment 2?  AFAICT there are Wr6
> failures for pushes both before and after the ones I made in this range.

Oops, sorry, I didn't notice comment 11.

Comment 14

[Intermittent Failures Robot]

130 failures in 2584 pushes (0.05 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 77
* try: 7
* mozilla-inbound: 39
* mozilla-beta: 2
* mozilla-central: 5

Platform breakdown:
* windows7-32-devedition: 2
* windows10-64: 64
* windows10-64-devedition: 1
* windows7-32: 63

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-22&endday=2018-10-28&tree=all

Comment 15

[Geoff Brown [:gbrown]]

(In reply to Cristina Coroiu [:ccoroiu] from comment #9)
> Since this is expected to fail, a disable is still needed? How can we
> proceed in this case?
> 
> :jmaher :gbrown can you please take a look?

Yes, for cases like this that both pass and fail, update the manifest to use 'disable' instead of 'expected'. See https://developer.mozilla.org/en-US/docs/Mozilla/QA/web-platform-tests#Disabling_tests for syntax.

Comment 16

[Intermittent Failures Robot]

23 failures in 443 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-beta: 1
* autoland: 14
* mozilla-inbound: 7
* try: 1

Platform breakdown:
* windows10-64: 11
* windows7-32: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-29&endday=2018-10-29&tree=all

Comment 17

[Eliza Balazs [:ebalazs_]]

Attachment: Skipped test on win

Comment 18

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9021109 [details] [diff] [review]
Skipped test on win

Review of attachment 9021109 [details] [diff] [review]:
-----------------------------------------------------------------

::: testing/web-platform/meta/css/css-writing-modes/abs-pos-non-replaced-icb-vrl-020.xht.ini
@@ +4,5 @@
>      if not debug and not webrender and e10s and (os == "win") and (version == "6.1.7601") and (processor == "x86") and (bits == 32): FAIL
>      if debug and not webrender and e10s and (os == "win") and (version == "10.0.15063") and (processor == "x86_64") and (bits == 64): FAIL
>      if not debug and not webrender and e10s and (os == "win") and (version == "10.0.15063") and (processor == "x86_64") and (bits == 64): FAIL
> +  disabled:
> +    if (os == "win"): https://bugzilla.mozilla.org/show_bug.cgi?id=1500226

I see other windows conditions listed here, we should remove those and just have the disabled: clause as you have added.

Comment 19

[Eliza Balazs [:ebalazs_]]

Attachment: Skipped test on Windows

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/3baebf8dd0f1
Disable abs-pos-non-replaced-icb-vrl-020.xht for frequent failures on win. r=jmaher

Comment 21

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/3baebf8dd0f1

Comment 22

[Intermittent Failures Robot]

23 failures in 542 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 3
* autoland: 15
* mozilla-inbound: 5

Platform breakdown:
* windows7-32: 13
* windows10-64: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-30&endday=2018-10-30&tree=all

Comment 23

[Intermittent Failures Robot]

56 failures in 2978 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-beta: 8
* autoland: 32
* mozilla-inbound: 12
* mozilla-central: 3
* try: 1

Platform breakdown:
* windows7-32: 26
* windows10-64: 28
* windows7-32-nightly: 1
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-10-29&endday=2018-11-04&tree=all

Comment 24

[Intermittent Failures Robot]

7 failures in 3007 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 7

Platform breakdown:
* windows7-32: 2
* windows7-32-nightly: 1
* windows10-64: 1
* windows7-32-devedition: 2
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-11-05&endday=2018-11-11&tree=all

Comment 25

[Intermittent Failures Robot]

10 failures in 2917 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 10

Platform breakdown:
* windows7-32-nightly: 1
* windows10-64: 5
* windows7-32: 1
* windows10-64-nightly: 2
* windows10-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 26

[Intermittent Failures Robot]

10 failures in 2917 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 10

Platform breakdown:
* windows7-32: 1
* windows7-32-nightly: 1
* windows10-64: 5
* windows10-64-nightly: 2
* windows10-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 27

[Intermittent Failures Robot]

3 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 3

Platform breakdown:
* windows7-32: 1
* windows7-32-devedition: 1
* windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 28

[Intermittent Failures Robot]

5 failures in 2808 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 5

Platform breakdown:
* windows10-64-nightly: 2
* windows10-64: 1
* windows7-32-nightly: 1
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 29

[Intermittent Failures Robot]

4 failures in 1862 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-release: 4

Platform breakdown:
* windows7-32-nightly: 1
* windows10-64-nightly: 1
* windows10-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1500226&startday=2018-12-03&endday=2018-12-09&tree=all