1401076 - Intermittent TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCPeerConnection-setRemoteDescription-offer.html | expected OK

Status: RESOLVED WORKSFORME

(Core :: WebRTC, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=131850593&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/F4vhGBFARPyz17PAyKEEog/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

20 failures in 175 pushes (0.114 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 10
* mozilla-beta: 9
* try: 1

Platform breakdown:
* windows10-64: 5
* windows7-32: 4
* windows10-64-devedition: 4
* windows7-32-nightly: 2
* windows10-64-stylo-disabled: 1
* windows10-64-nightly: 1
* osx-10-10: 1
* macosx64-stylo-disabled: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-19&endday=2017-09-19&tree=all

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

:mreavy we have 42 failures in the last 3 days: https://brasstacks.mozilla.com/orangefactor/index.html?display=Bug&bugid=1401076, can you help find someone to look at this and make a decision to fix or disable this test?

Comment 3

[Maire Reavy [:mreavy]]

Nils -- See comment 2 from Joel.  This test will likely be disabled soon if we don't look at it soon because it has increased in frequency.  It's currently a P5, but we should re-evaluate given the increased failure rate.

Comment 4

[Intermittent Failures Robot]

26 failures in 199 pushes (0.131 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 13
* mozilla-beta: 9
* mozilla-inbound: 2
* mozilla-central: 2

Platform breakdown:
* windows10-64: 6
* windows7-32-nightly: 3
* osx-10-10: 3
* windows7-32-stylo-disabled: 2
* windows7-32: 2
* windows10-64-nightly: 2
* windows10-64-devedition: 2
* linux64: 2
* windows7-32-devedition: 1
* macosx64-stylo-disabled: 1
* macosx64-nightly: 1
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-21&endday=2017-09-21&tree=all

Comment 5

[Nils Ohlmeier [:drno]]

James, the only suspicious thing I keep seeing in the logs of these failures here is:

JavaScript error: executormarionette.py, line 28: TypeError: window.wrappedJSObject.win.timeout is not a function

But I fail to locate where in executormarionette.py this is coming from. Can you help me locate this?

BTW bug 1387673 shows exactly the same error message.

Comment 6

[James Graham [:jgraham]]

That's from http://searchfox.org/mozilla-central/source/testing/web-platform/tests/tools/wptrunner/wptrunner/executors/testharness_marionette.js which is a script injected into the harness window in order to start the test. That message suggests that either the test page itself was navigated, or it somehow changed security context so we can't access it from the harness window any more. The first of these options seems more likely.

Comment 7

[Nils Ohlmeier [:drno]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=3317bdc85b2d39172666b8a5f2e44c3831b0e4c2

Comment 8

[Nils Ohlmeier [:drno]]

Attachment: Bug 1401076: swapping order to avoid timing issues

Review commit: https://reviewboard.mozilla.org/r/182778/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/182778/

Comment 9

[Intermittent Failures Robot]

22 failures in 139 pushes (0.158 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 7
* mozilla-beta: 7
* autoland: 5
* mozilla-central: 2
* try: 1

Platform breakdown:
* windows7-32-stylo-disabled: 3
* windows10-64-stylo-disabled: 3
* windows10-64: 3
* macosx64-stylo-disabled: 3
* windows7-32: 2
* windows10-64-nightly: 2
* windows10-64-devedition: 2
* windows7-32-devedition: 1
* osx-10-10: 1
* macosx64-devedition: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-22&endday=2017-09-22&tree=all

Comment 10

[Nils Ohlmeier [:drno]]

Comment on attachment 8911278 [details]
Bug 1401076: swapping order to avoid timing issues

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/182778/diff/1-2/

Comment 11

[Intermittent Failures Robot]

19 failures in 53 pushes (0.358 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-beta: 9
* mozilla-inbound: 4
* mozilla-central: 4
* autoland: 2

Platform breakdown:
* windows7-32-stylo-disabled: 3
* windows10-64: 3
* windows7-32-nightly: 2
* windows10-64-nightly: 2
* windows10-64-devedition: 2
* linux64: 2
* windows7-32-devedition: 1
* windows7-32: 1
* windows10-64-stylo-disabled: 1
* macosx64-nightly: 1
* linux64-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-23&endday=2017-09-23&tree=all

Comment 12

[Intermittent Failures Robot]

113 failures in 943 pushes (0.12 failures/push) were associated with this bug in the last 7 days. 

This is the #11 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* mozilla-beta: 38
* autoland: 35
* mozilla-inbound: 24
* mozilla-central: 14
* try: 2

Platform breakdown:
* windows10-64: 21
* windows7-32: 12
* osx-10-10: 12
* windows10-64-devedition: 11
* windows7-32-stylo-disabled: 10
* windows10-64-nightly: 10
* macosx64-stylo-disabled: 8
* windows7-32-nightly: 7
* windows10-64-stylo-disabled: 5
* linux64: 5
* windows7-32-devedition: 3
* linux32: 3
* macosx64-nightly: 2
* macosx64-devedition: 2
* linux64-stylo-disabled: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 13

[Intermittent Failures Robot]

21 failures in 129 pushes (0.163 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-beta: 9
* autoland: 6
* mozilla-inbound: 4
* try: 2

Platform breakdown:
* windows10-64-devedition: 5
* linux64: 3
* windows7-32-stylo-disabled: 2
* windows10-64-stylo-disabled: 2
* windows10-64-nightly: 2
* windows10-64: 2
* linux32-stylo-disabled: 2
* macosx64-stylo-disabled: 1
* macosx64-devedition: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-25&endday=2017-09-25&tree=all

Comment 14

[Intermittent Failures Robot]

23 failures in 178 pushes (0.129 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 9
* mozilla-beta: 7
* mozilla-inbound: 4
* mozilla-central: 2
* try: 1

Platform breakdown:
* windows10-64-nightly: 6
* windows7-32-stylo-disabled: 4
* windows10-64-stylo-disabled: 3
* macosx64-stylo-disabled: 3
* osx-10-10: 2
* linux64: 2
* windows7-32: 1
* windows10-64-devedition: 1
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-26&endday=2017-09-26&tree=all

Comment 15

[Intermittent Failures Robot]

23 failures in 153 pushes (0.15 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 9
* mozilla-beta: 9
* try: 2
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* windows7-32-stylo-disabled: 4
* windows10-64-devedition: 3
* windows10-64: 3
* macosx64-stylo-disabled: 2
* macosx64-nightly: 2
* macosx64-devedition: 2
* linux64: 2
* windows7-32-devedition: 1
* windows10-64-stylo-disabled: 1
* windows10-64-nightly: 1
* osx-10-10: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-27&endday=2017-09-27&tree=all

Comment 16

[Nils Ohlmeier [:drno]]

Sorry I stared at the code for some time, but I don't see why this could be hanging. I'll get back to it at a later time.

Comment 17

[Intermittent Failures Robot]

25 failures in 195 pushes (0.128 failures/push) were associated with this bug yesterday.    

** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-inbound: 10
* autoland: 7
* mozilla-central: 3
* mozilla-beta: 3
* try: 1
* oak: 1

Platform breakdown:
* windows7-32: 5
* osx-10-10: 4
* windows7-32-stylo-disabled: 3
* windows10-64-stylo-disabled: 3
* windows10-64: 3
* windows10-64-nightly: 2
* linux32: 2
* macosx64-stylo-disabled: 1
* linux64: 1
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-28&endday=2017-09-28&tree=all

Comment 18

[Ryan VanderMeulen [:RyanVM]]

Disabling for now in that case. Thanks for the update, Nils.

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/02db26dacb4e
Skip webrtc/RTCPeerConnection-setRemoteDescription-offer.html for frequent timeouts.

Comment 20

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/8b526273748e

Comment 21

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/02db26dacb4e

Comment 22

[Intermittent Failures Robot]

17 failures in 163 pushes (0.104 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-beta: 9
* autoland: 4
* mozilla-inbound: 3
* mozilla-central: 1

Platform breakdown:
* windows10-64: 6
* windows10-64-stylo-disabled: 3
* windows10-64-nightly: 3
* linux64-devedition: 2
* macosx64-stylo-disabled: 1
* linux32-stylo-disabled: 1
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-29&endday=2017-09-29&tree=all

Comment 23

[Intermittent Failures Robot]

113 failures in 885 pushes (0.128 failures/push) were associated with this bug in the last 7 days. 

This is the #13 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* mozilla-beta: 37
* autoland: 32
* mozilla-inbound: 22
* mozilla-central: 14
* try: 7
* oak: 1

Platform breakdown:
* windows10-64: 18
* windows10-64-nightly: 15
* windows10-64-stylo-disabled: 14
* macosx64-stylo-disabled: 12
* windows7-32-stylo-disabled: 9
* windows10-64-devedition: 9
* osx-10-10: 7
* linux64: 7
* windows7-32: 5
* linux32-stylo-disabled: 5
* linux32: 5
* macosx64-nightly: 2
* macosx64-devedition: 2
* linux64-devedition: 2
* windows7-32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401076&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 24

[Nils Ohlmeier [:drno]]

I don't have the capacity any more to work on this any time soon.

Comment 25

[Intermittent Failures Robot]

1 failures in 4298 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1401076&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures in 4292 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1401076&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 3801 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1401076&startday=2019-10-07&endday=2019-10-13&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 3964 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1401076&startday=2019-10-14&endday=2019-10-20&tree=all