Closed Bug 1076786 Opened 7 years ago Closed 6 years ago

Web-platform-tests are too intermittent to enable on OSX

Categories

(Testing :: web-platform-tests, defect)

x86_64
Linux
defect
Not set
normal

Tracking

(firefox39 fixed)

RESOLVED FIXED
mozilla39
Tracking Status
firefox39 --- fixed

People

(Reporter: jgraham, Assigned: jgraham)

Details

Attachments

(2 files)

For some reason OSX seems to show more instability than other platforms. This suggests that the problem is either with marionette or core gecko on that platform. The instability isn't obviously limited to one set of tests. I spent some time with a slave trying to reproduce this and the most suspicious thing was that when a test unexpectedly timed out, it seemed to be impossible to load any further pages in that browser session without clearing the cache.

If this is a gecko problem I expect I will need some insight from gecko hackers to resolve it.
This improved greatly when jdm patched sptserve to queue more connections.

Based on cedar testing, I now think these are stable enough to enable on 10.8 (but not 10.6).
Attached patch wpt_osx.diffSplinter Review
Enable wpt on OSX 10.8 for non-cedar trees. Tested using braindump and it seems to do the right thing.
Attachment #8548989 - Flags: review?(armenzg)
Attachment #8548989 - Flags: review?(armenzg) → review+
Attached patch wpt_osx.diffSplinter Review
This didn't land before the 38 uplift to aurora, so attached a rebased version of the patch that should only enable things for >= 39 (this time I plan to land it right away).
Attachment #8568588 - Flags: review?(armenzg)
Attachment #8568588 - Flags: review?(armenzg) → review+
So...2 10.8 W2 runs on inbound so far, both failing. I'm going to be hiding it now.

https://treeherder.mozilla.org/logviewer.html#?job_id=6987876&repo=mozilla-inbound
Assignee: nobody → james
Flags: needinfo?(james)
https://hg.mozilla.org/mozilla-central/rev/b1c87ca5d769
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla39
I think this should be unhidden now.
Flags: needinfo?(james)
You need to log in before you can comment on or make changes to this bug.