1534543 - Intermittent /webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html | Testing http://web-platform.test:8000/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html == http://web-platform.test:8000/webvtt/

Status: RESOLVED INCOMPLETE

(Core :: Audio/Video: Playback, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: aciure [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=233311788&repo=autoland

https://queue.taskcluster.net/v1/task/cCq6l_uxTWWo3gDvD1lkQg/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/cCq6l_uxTWWo3gDvD1lkQg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

05:51:21 INFO - TEST-START | /webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html
05:51:21 INFO - PID 5884 | 1552369881398 Marionette INFO Testing http://web-platform.test:8000/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html == http://web-platform.test:8000/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby-ref.html
05:51:21 INFO - PID 5884 | JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 2383: TypeError: tabbrowser.getTabForBrowser is not a function
05:51:21 INFO - PID 5884 | JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 2383: TypeError: tabbrowser.getTabForBrowser is not a function
05:51:21 INFO - PID 5884 | 1552369881513 Marionette INFO No differences allowed
05:51:21 INFO - PID 5884 | 1552369881513 Marionette INFO Found 43069 pixels different, maximum difference per channel 127
05:51:21 INFO - TEST-UNEXPECTED-FAIL | /webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html | Testing http://web-platform.test:8000/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html == http://web-platform.test:8000/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby-ref.html
05:51:21 INFO - TEST-INFO took 211ms
05:51:21 INFO - PID 5884 | [Parent 5928, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 3260, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 3260, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | 1552369881593 Marionette INFO Stopped listening on port 2828
05:51:21 INFO - PID 5884 | [Parent 5928, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 4420, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Parent 5928, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 5664, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Parent 5928, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 4116, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:21 INFO - PID 5884 | [Child 4116, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
05:51:22 INFO - Browser exited with return code 0
05:51:22 INFO - PROCESS LEAKS None
05:51:22 INFO - Closing logging queue
05:51:22 INFO - queue closed
05:51:22 INFO - Setting up ssl
05:51:22 INFO - certutil |
05:51:22 INFO - certutil |
05:51:22 INFO - certutil |
05:51:22 INFO - Certificate Nickname Trust Attributes
05:51:22 INFO - SSL,S/MIME,JAR/XPI
05:51:22 INFO -
05:51:22 INFO - web-platform-tests CT,,
05:51:22 INFO -
05:51:22 INFO - Application command: Z:\task_1552368508\build\application\firefox\firefox.exe -marionette about:blank --wait-for-browser -profile c:\users\task_1552368508\appdata\local\temp\tmpnwd6ir.mozrunner

Comment 1

[Bogdan Tara[:bogdan_tara | bogdant]]

:kats is it possible these are introduced by your changes landed with bug 1515432 ?
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&fromchange=52b03bc3489944b2f695b79754615edf7d38bd27&searchStr=windows%2C10%2Cx64%2Cccov%2Cdebug%2Cweb%2Cplatform%2Ctests%2Cwith%2Ce10s%2Ctest-windows10-64-ccov%2Fdebug-web-platform-tests-reftests-e10s-4%2Cw-e10s%28wr4%29&tochange=4d15e90af575a68815975bac8c2b602f78d76ee8

Comment 2

[Kartikaya Gupta (email:[e-mail])]

Bug 1515432 landed a month ago, while your pushlog link seems to indicate this is a much more recent regression (in the last day). And the only change that bug made to bidi_ruby.html.ini was adding parentheses, so that wouldn't have affected anything.

Comment 3

[Intermittent Failures Robot]

58 failures in 513 pushes (0.113 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 36
• mozilla-inbound: 3
• try: 4

Platform breakdown:

• linux64: 7
• linux32: 5
• windows7-32: 10
• linux64-ccov: 5
• windows10-64-ccov: 30
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-12&endday=2019-03-12&tree=all

Comment 4

[Cristina Coroiu [:ccoroiu]]

Caused by https://bugzilla.mozilla.org/show_bug.cgi?id=1531863

Retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=wr&tochange=7ae9bc24596f95a6bb69fcf1ce3d810ee478b6a0&fromchange=95274fd66e5bea637cc26d7047aef7f96d5e19a7

https://bugzilla.mozilla.org/show_bug.cgi?id=1534541#c3

Comment 5

[Intermittent Failures Robot]

49 failures in 507 pushes (0.097 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 23
• autoland: 17
• try: 3
• mozilla-inbound: 6

Platform breakdown:

• linux64: 20
• windows10-64-ccov: 7
• linux32: 8
• linux64-ccov: 6
• windows7-32: 6
• windows7-32-nightly: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-13&endday=2019-03-13&tree=all

Comment 6

[Andreea Pavel [:apavel]]

Alastor is the comment Cristina mentioned above valid for this bug too?

Comment 7

[Alastor Wu [:alwu]]

It seems to me that the difference pixels are caused by graphic rendering, it's not exactly a WebVTT issue. I think it could be fixed after we introduce fizzy for wpt, which will be implemented in bug1478472.

Comment 8

[Andreea Pavel [:apavel]]

Thank you!

Comment 9

[Intermittent Failures Robot]

43 failures in 524 pushes (0.082 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 12
• mozilla-inbound: 4
• try: 4
• mozilla-central: 21
• mozilla-beta: 2

Platform breakdown:

• linux64: 14
• windows7-32: 5
• windows10-64-ccov: 6
• windows10-64: 4
• linux64-ccov: 5
• windows10-64-nightly: 2
• linux32: 6
• windows10-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-14&endday=2019-03-14&tree=all

Comment 10

[Intermittent Failures Robot]

39 failures in 436 pushes (0.089 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 6
• mozilla-central: 16
• autoland: 11
• mozilla-inbound: 6

Platform breakdown:

• linux32: 4
• linux64: 13
• windows10-64-ccov: 5
• linux64-ccov: 5
• windows7-32: 6
• windows10-64: 3
• windows7-32-nightly: 1
• windows10-64-devedition: 1
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-15&endday=2019-03-15&tree=all

Comment 11

[Intermittent Failures Robot]

21 failures in 167 pushes (0.126 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 8
• mozilla-central: 5
• try: 3
• mozilla-inbound: 5

Platform breakdown:

• linux64: 5
• windows7-32: 5
• linux32: 3
• windows10-64: 2
• linux64-ccov: 1
• windows10-64-ccov: 2
• windows10-64-devedition: 2
• windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-16&endday=2019-03-16&tree=all

Comment 12

[Intermittent Failures Robot]

240 failures in 2771 pushes (0.087 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 76
• mozilla-central: 112
• mozilla-inbound: 27
• try: 23
• mozilla-beta: 2

Platform breakdown:

• linux64: 68
• linux32: 31
• windows7-32: 39
• linux64-ccov: 24
• windows10-64-ccov: 54
• windows7-32-devedition: 1
• windows7-32-nightly: 4
• windows10-64: 11
• windows10-64-nightly: 3
• windows10-64-devedition: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 13

[Alastor Wu [:alwu]]

Hi, Andreea,
Because bug1478472 hasn't landed yet, so I think we should disable this test and check whether fuzzy can fix the intermittent later. Could you help me disable this test?
Thank you.

Comment 14

[Intermittent Failures Robot]

39 failures in 413 pushes (0.094 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-central: 7
• try: 4
• mozilla-inbound: 6
• mozilla-beta: 1

Platform breakdown:

• linux64: 17
• windows10-64: 3
• windows10-64-ccov: 2
• linux32: 12
• linux64-ccov: 1
• windows7-32: 3
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-18&endday=2019-03-18&tree=all

Comment 15

[Daniel Varga [:dvarga]]

Attachment: Bug 1534543 - disable bidi_ruby.html on linux and windows for frequent failures, r=jmaher

Comment 16

[Andreea Pavel [:apavel]]

On Tue, March 19, 2019, 1:39 PM GMT+2, by [e-mail].
Revisions: D23998 diff 77712
Details: We're sorry, Autoland could not rebase your commits for you automatically. Please manually rebase your commits and try again. (255, 'applying /tmp/tmp2nMViz\npatching file testing/web-platform/meta/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html.ini\nHunk #1 FAILED at 0\n1 out of 1 hunks FAILED -- saving rejects to file testing/web-platform/meta/webvtt/rendering/cues-with-video/processing-model/bidi/bidi_ruby.html.ini.rej\nabort: patch failed to apply', '')

Alastor, sure. The patch made failed to land, we'll fix it.

Comment 17

[Intermittent Failures Robot]

16 failures in 512 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 3
• autoland: 4
• mozilla-central: 4
• try: 5

Platform breakdown:

• linux64: 7
• windows10-64: 2
• windows7-32: 2
• linux32: 3
• windows10-64-ccov: 1
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-19&endday=2019-03-19&tree=all

Comment 18

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Bug 1488673 part 9 / https://hg.mozilla.org/integration/autoland/rev/2a0158d3e47c changed it to expected fail in general. Wouldn't that cause unexpected passes (because it's not disabling them)?

Comment 19

[Alastor Wu [:alwu]]

I think now bidi_ruby.html won't pass, because we've changed the positioning algorithm. I'm going to investigate and enable it later. The bug1534862 is used to be a meta bug for those wpt tests fail.

Comment 20

[Andreea Pavel [:apavel]]

No other failure since the 20th of March.

Comment 21

[Intermittent Failures Robot]

69 failures in 2561 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #32 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 25
• mozilla-inbound: 9
• try: 12
• mozilla-central: 11
• mozilla-beta: 12

Platform breakdown:

• linux64: 28
• windows10-64: 5
• linux32: 17
• windows10-64-ccov: 3
• linux64-ccov: 1
• windows7-32: 5
• windows7-32-devedition: 6
• windows10-64-devedition: 1
• windows7-32-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 22

[Intermittent Failures Robot]

25 failures in 3910 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 25

Platform breakdown:

• linux64: 7
• linux32: 4
• windows7-32-devedition: 6
• windows7-32-nightly: 5
• windows10-64-devedition: 2
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 23

[Intermittent Failures Robot]

23 failures in 2843 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 23

Platform breakdown:

• linux32: 4
• windows10-64-devedition: 3
• windows7-32-nightly: 4
• windows7-32-devedition: 5
• linux64: 3
• windows10-64-nightly: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 24

[Intermittent Failures Robot]

23 failures in 3025 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 23

Platform breakdown:

• windows10-64-devedition: 4
• linux64: 6
• windows7-32-devedition: 3
• windows7-32-nightly: 3
• windows10-64-nightly: 4
• linux32: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 25

[Intermittent Failures Robot]

15 failures in 2673 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 15

Platform breakdown:

• linux64: 3
• linux32: 2
• windows10-64-nightly: 5
• windows7-32-devedition: 1
• windows10-64-devedition: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 26

[Intermittent Failures Robot]

13 failures in 3031 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 13

Platform breakdown:

• linux64: 6
• linux32: 2
• windows10-64-devedition: 2
• windows7-32-nightly: 1
• windows7-32-devedition: 1
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 27

[Intermittent Failures Robot]

19 failures in 4131 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 19

Platform breakdown:

• windows7-32-nightly: 6
• windows10-64-devedition: 4
• linux32: 1
• windows10-64-nightly: 4
• linux64: 2
• windows7-32-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 28

[Intermittent Failures Robot]

19 failures in 4705 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 19

Platform breakdown:

• linux64: 7
• windows10-64-devedition: 3
• windows7-32-devedition: 3
• linux32: 2
• windows10-64-nightly: 3
• windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 29

[Intermittent Failures Robot]

4 failures in 4658 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform breakdown:

• windows10-64-nightly: 1
• linux64: 2
• linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 30

[Intermittent Failures Robot]

3 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform breakdown:

• linux32: 1
• windows10-64-nightly: 1
• windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 31

[Intermittent Failures Robot]

3 failures in 4337 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform breakdown:

• linux32: 2
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 32

[Intermittent Failures Robot]

2 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform breakdown:

• linux64: 1
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 33

[Intermittent Failures Robot]

4 failures in 4753 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform breakdown:

• linux64: 1
• windows7-32-nightly: 2
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 34

[Intermittent Failures Robot]

6 failures in 2581 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 6

Platform breakdown:

• linux64: 4
• linux32: 1
• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534543&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 35

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup