1420167 - Perma test-verify dom/vr/test/mochitest/test_vrController_displayId.html | Test timed out. - Test timed out.

Status: RESOLVED FIXED

(Core :: WebVR, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=147075874&repo=mozilla-central

https://queue.taskcluster.net/v1/task/XesT4PsPTnGpwp-gjgBp_w/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Geoff Brown [:gbrown]]

Test verification of test_vrController_displayId.html was triggered when the test was modified by bug 1407423; those changes have been backed out for other failures. On backout, test verification of test_vrController_displayId.html was triggered again, and failed again, on all platforms except Android.

Comment 2

[Intermittent Failures Robot]

40 failures in 146 pushes (0.274 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 16
* mozilla-inbound: 12
* autoland: 12

Platform breakdown:
* linux64: 12
* windows7-32: 9
* windows10-64: 9
* osx-10-10: 6
* windows7-32-nightly: 1
* windows10-64-nightly: 1
* macosx64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1420167&startday=2017-11-23&endday=2017-11-23&tree=all

Comment 3

[Intermittent Failures Robot]

52 failures in 744 pushes (0.07 failures/push) were associated with this bug in the last 7 days. 

This is the #14 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 24
* mozilla-central: 16
* autoland: 12

Platform breakdown:
* linux64: 16
* windows7-32: 12
* windows10-64: 12
* osx-10-10: 8
* windows7-32-nightly: 1
* windows10-64-nightly: 1
* macosx64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1420167&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

is this still broken?  no failures since November 23rd.  :gbrown, how does test-verify know when to run and keep reporting errors?

Comment 5

[Geoff Brown [:gbrown]]

test-verify only runs when a test is modified. So we expect it to fail -- typically consistently and often on multiple platforms -- when the test is modified, and then to see no more failures unless the test is modified again.

In this case, see comment 1: The test failed verification when it was modified, then the modification was backed out and it still failed verification. It apparently hasn't been modified since.


It's easy to see this happening locally (I ran on Linux):

mach mochitest dom/vr/test/mochitest/test_vrController_displayId.html is OK
mach mochitest dom/vr/test/mochitest/test_vrController_displayId.html --verify consistently hangs on second iteration
mach mochitest dom/vr/test/mochitest/test_vrController_displayId.html --repeat 2 consistently hangs on second iteration

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

in summary this test case will not pass test-verify by failing on the second time it is run in the same browser session.

Comment 7

[Daosheng Mu[:daoshengmu]]

Well, it can be reproduced via `./mach mochitest --repeat=5 dom/vr/test/mochitest/test_vrController_displayId.html`. I believe it could be a new regression from the recent multi-threading work.

Comment 8

[Daosheng Mu[:daoshengmu]]

Attachment: Bug 1420167 - Clean the current test system when creating a new VR test system;

Review commit: https://reviewboard.mozilla.org/r/203792/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/203792/

Comment 9

[:kip (Kearwood Gilbert)]

Comment on attachment 8932747 [details]
Bug 1420167 - Clean the current test system when creating a new VR test system;

https://reviewboard.mozilla.org/r/203792/#review209552

This LGTM, thanks!

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bec19f67b06c
Clean the current test system when creating a new VR test system; r=kip

Comment 11

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/bec19f67b06c