1551718 - mochitest-devtools-webreplay runs no tests

Status: RESOLVED FIXED

(Testing :: Mochitest, defect)

Description

[Geoff Brown [:gbrown]]

M(dt-wr) tasks run on osx-shippable only. Currently, the task runs no tests at all (but passes):

https://treeherder.mozilla.org/logviewer.html#?job_id=246433340&repo=mozilla-central

These tasks were running the correct subsuite in the past.

Discovered in bug 1535287.

I think the issue is a mismatch between 'mochitest-devtools-webreplay' and 'mochitest-devtools-chrome-webreplay'. Verifying...

Comment 1

[Geoff Brown [:gbrown]]

(In reply to Geoff Brown [:gbrown] from comment #0)

I think the issue is a mismatch between 'mochitest-devtools-webreplay' and 'mochitest-devtools-chrome-webreplay'.

That changed at https://hg.mozilla.org/integration/autoland/rev/60c512bab3e9#l8.46

Comment 2

[Geoff Brown [:gbrown]]

Attachment: Bug 1551718 - Actually run tests in mochitest-devtools-webreplay; r=ahal

Corrects a suite name mismatch.

Comment 3

[Geoff Brown [:gbrown]]

Attachment: Bug 1551718 - Disable perma-failing webreplay tests; r=jdescottes

When webreplay tests are enabled, there are now 3 perma-failing tests:
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=74dff9ebd140f837636613efeecb2590b2645a98
We can skip those tests so the task passes:
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=8a9d36feb19ec5139a4b4beb131ac69a3c814209

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0384e2221ced
Disable perma-failing webreplay tests; r=jdescottes
https://hg.mozilla.org/integration/autoland/rev/0aba6e58bd62
Actually run tests in mochitest-devtools-webreplay; r=ahal

Comment 5

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/0384e2221ced
https://hg.mozilla.org/mozilla-central/rev/0aba6e58bd62