Closed Bug 1397912 Opened 2 years ago Closed 2 years ago

Intermittent TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/sessions/new_session/create.py | expected OK

Categories

(Testing :: geckodriver, defect, P5)

Version 3
defect

Tracking

(firefox57 fixed, firefox58 fixed)

RESOLVED FIXED
mozilla58
Tracking Status
firefox57 --- fixed
firefox58 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: jgraham)

References

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell fixed:other])

Attachments

(1 file)

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=129331336&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/R9rK7zYqQICjYflgHUUDWQ/runs/0/artifacts/public/logs/live_backing.log

[task 2017-09-07T20:47:43.824048Z] 20:47:43     INFO - STDOUT: PASSED
[task 2017-09-07T20:47:43.827637Z] 20:47:43     INFO - PID 2775 | 1504817263824	Marionette	INFO	New connections will no longer be accepted
[task 2017-09-07T20:47:44.078201Z] 20:47:44     INFO - PID 2775 | [Child 5314] WARNING: pipe error (15): Connection reset by peer: file /build/firefox-S0wyi8/firefox-55.0.2+build1/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 353
[task 2017-09-07T20:47:44.078333Z] 20:47:44     INFO - PID 2775 | [Child 5314] WARNING: pipe error (3): Connection reset by peer: file /build/firefox-S0wyi8/firefox-55.0.2+build1/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 353
[task 2017-09-07T20:47:44.081676Z] 20:47:44     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/sessions/new_session/create.py::test_valid[test:extension-True-body0] 
[task 2017-09-07T20:47:44.097970Z] 20:47:44     INFO - PID 2775 | 1504817264083	geckodriver::marionette	INFO	Starting browser /usr/bin/firefox with args ["-marionette"]
[task 2017-09-07T20:47:45.169426Z] 20:47:45     INFO - PID 2775 | 1504817265163	Marionette	INFO	Enabled via --marionette
[task 2017-09-07T20:47:46.459729Z] 20:47:46     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/sessions/new_session/create.py | expected OK
[task 2017-09-07T20:47:44.097970Z] 20:47:44     INFO - PID 2775 | 1504817264083	geckodriver::marionette	INFO	Starting browser /usr/bin/firefox with args ["-marionette"]
[task 2017-09-07T20:47:45.169426Z] 20:47:45     INFO - PID 2775 | 1504817265163	Marionette	INFO	Enabled via --marionette
[task 2017-09-07T20:47:46.459729Z] 20:47:46     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/sessions/new_session/create.py | expected OK

We time out after 60s now given that Marionette client is not correctly used by web-platform tests. Bug 1397675 might help here.
Depends on: 1397675
So something is strange on those failures:

[task 2017-09-13T20:34:49.488910Z] 20:34:49     INFO - PID 2940 | 1505334889484	geckodriver::marionette	INFO	Starting browser /usr/bin/firefox with args ["-marionette"]
[task 2017-09-13T20:34:50.158721Z] 20:34:50     INFO - PID 2940 | 1505334890153	Marionette	INFO	Enabled via --marionette
[task 2017-09-13T20:34:50.913911Z] 20:34:50     INFO - TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/sessions/new_session/create.py | expected OK
[task 2017-09-13T20:34:50.914782Z] 20:34:50     INFO - TEST-INFO took 125012ms

We start the browser and timeout immediately as if a timeout value of 0s is set. James, any idea why this could happen? Sadly the log is not helpful at all.
Flags: needinfo?(james)
The test creates multiple sessions, so the timeout is unrelated to the session that was just created. It has an overall 125s timeout. We are hitting that limit intermittently. The right way to fix this is probably to split the test up like I originally did.
Flags: needinfo?(james)
the failure rate is remaining high:
https://brasstacks.mozilla.com/orangefactor/index.html?display=Bug&bugid=1397912

linux64 opt/pgo specifically.

:jgraham, based on comment 5, do you have a pending patch for this?  If not, do you know who on the team would be a good candidate for writing that patch or any patch to fix this issue?
Flags: needinfo?(james)
Whiteboard: [stockwell needswork]
Comment on attachment 8911112 [details]
Bug 1397912 - Split wdspec session creation tests for intermittent timeouts,

https://reviewboard.mozilla.org/r/182604/#review187884
Attachment #8911112 - Flags: review?(ato) → review+
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/9ebe05258185
Split wdspec session creation tests for intermittent timeouts, r=ato
https://hg.mozilla.org/mozilla-central/rev/9ebe05258185
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla57
Flags: needinfo?(james)
Assignee: nobody → james
Target Milestone: mozilla57 → mozilla58
Whiteboard: [stockwell needswork] → [stockwell fixed:other]
You need to log in before you can comment on or make changes to this bug.