Closed Bug 1460239 Opened 2 years ago Closed 2 years ago

[wdspec] Use longer timeout for all user prompt tests

Categories

(Testing :: geckodriver, enhancement, P1)

Version 3
enhancement

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: whimboo, Assigned: whimboo)

References

(Depends on 1 open bug)

Details

Attachments

(1 file)

To be finally able to continue on bug 1434618 with an earlier shutdown of workers I would propose we increase the timeout for user prompt tests. This would unblock us from doing this major change in Firefox.
(In reply to Henrik Skupin (:whimboo) from comment #0)

> To be finally able to continue on bug 1434618 with an earlier
> shutdown of workers I would propose we increase the timeout for
> user prompt tests. This would unblock us from doing this major
> change in Firefox.

Why would extending the timeout unblock us?  Are these currently
timing out?

I thought the plan here was to _disable_ the user prompt handler
tests until we have implemented it.
I can disable but that doesn't help us to identify any remaining shutdown hangs. Increasing the timeout might be counter-productive but at least we could identify shutdown hangs by letting the background hang monitor to kick in.

But if you think that we should disable them all, let me know and we can do that instead.
Flags: needinfo?(ato)
(In reply to Henrik Skupin (:whimboo) from comment #3)

> I can disable but that doesn't help us to identify any remaining
> shutdown hangs. Increasing the timeout might be counter-productive
> but at least we could identify shutdown hangs by letting the
> background hang monitor to kick in.
> 
> But if you think that we should disable them all, let me know and
> we can do that instead.

I think I would personally prefer not to run tests for features we
know we don’t support and which we know are causing problems due
to significant shutdown hangs, but if you think the tests are useful
for identifying the shutdown hang then landing them with an extended
timeout would make some sense.
Flags: needinfo?(ato)
Comment on attachment 8974351 [details]
Bug 1460239 - [wdspec] Use longer timeout for all user prompt tests.

https://reviewboard.mozilla.org/r/242694/#review248582
Attachment #8974351 - Flags: review?(ato) → review+
Andrea, can you please run your patch with the one here applied too? Do the wd failures stop? If not we will have to completely disable the tests.
Flags: needinfo?(amarchesini)
So that looks good. I only forgot to add the longer timeout to the new session tests which have the same problem. I will update the patch in a moment.
I checked and both the new session tests have already a longer timeout. So there is nothing wrong on our side. Given some extra findings I made and which I will report on bug 1434618 I'm a bit vague if we should really push that patch on this bug. I think it will be wise to wait if those user prompts tests generally fail on integration branches.
As it looks like most of the unexpected failures and timeouts we currently see are from webrender enabled builds. As such I'm going to disable the tests for that particular build on bug 1461253.
Depends on: 1461253
I would close this bug for now and concentrate more on bug 1460193.
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Depends on: 1460193
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.