1410248 - speech-api wpt disabled on import for intermittent crashes

Status: REOPENED

(Core :: Web Speech, enhancement)

Comment 1

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/83dfc2b82faa
Disable speech-api test for intermittent crashes, a=testonly

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Backed out wpt changes for references to removed files in wpt's moz.build file:

Bug 1410245
https://hg.mozilla.org/integration/mozilla-inbound/rev/7b038de8c843650b0088486116cf5c55ff1f5e5c
https://hg.mozilla.org/integration/mozilla-inbound/rev/2e7aa387d92f4087225039c1647e19b50dbf1dc9
https://hg.mozilla.org/integration/mozilla-inbound/rev/4b2c76feaf08bb31da943ecb1e3520f7b74e50aa

Bug 1410247
https://hg.mozilla.org/integration/mozilla-inbound/rev/0b73d0d50db543bcbcf67e57666718851e907b60

Bug 1410248
https://hg.mozilla.org/integration/mozilla-inbound/rev/94229175464cc52c9e125ca20dfcacd247e96077

Bug 1410242
https://hg.mozilla.org/integration/mozilla-inbound/rev/f87837f62f4800fd2561c20acdd2cecf2bfda348

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/befce45a7a46
Disable speech-api test for intermittent crashes, a=testonly

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/66cafcbfa5ed
Disable speech-api test for intermittent crashes, a=testonly CLOSED TREE

Comment 5

[Pulsebot]

Backout by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b6f3d038d50a
Backed out changeset 66cafcbfa5ed 
https://hg.mozilla.org/integration/mozilla-inbound/rev/e2c66f2f3c0c
Backed out changeset befce45a7a46

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/5e68550b3796
Disable speech-api test for intermittent crashes, a=testonly

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/5e68550b3796

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/34cbb525ecce
Disable all speech-api web platform tests until they can run reliably. r=me

Comment 9

[Ryan VanderMeulen [:RyanVM]]

James, I had to disable the rest for ongoing failures like the log below.
https://treeherder.mozilla.org/logviewer.html#?job_id=139491747&repo=mozilla-inbound

Rather than play whack-a-mole with a 30+% failure rate, I took the route of fastest to green.

Comment 10

[Makoto Kato [:m_kato]]

SpeechSynthesis-speak-twice.html is added by bug 1372325 and https://github.com/w3c/speech-api/issues/7.  Maybe, wpt should use mock speech synthesis prefs like mochitest.

Comment 11

[Attila Craciun [:arny]]

https://hg.mozilla.org/mozilla-central/rev/34cbb525ecce

Comment 12

[James Graham [:jgraham]]

RyanVM - Thanks for disabling more tests rather than backing out the whole import. Much appreciated.

m_kato - Probably it should; if you want to do that they can be added to a __dir__.ini file in testing/web-platform/meta/speech-api/ like

prefs: [pref1:value, pref2:value]

However I would expect that the crash needs to be fixed independent of whether those prefs ought to be fixed.

Comment 13

[Intermittent Failures Robot]

1 failures in 912 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1410248&startday=2017-10-23&endday=2017-10-29&tree=all