1550691 - High frequency intermittent Tier 2 TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamountlow event fires after send() is complete - Test timed out

Status: RESOLVED FIXED

(Core :: WebRTC, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=245697384&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/VQjP1VjfQhSmt_PjrVoujA/runs/0/artifacts/public/logs/live_backing.log

---

06:23:55 INFO - TEST-PASS | /webrtc/RTCDataChannel-bufferedAmount.html | bufferedAmount should increase by byte length for each message sent
06:23:55 INFO - TEST-PASS | /webrtc/RTCDataChannel-bufferedAmount.html | bufferedAmount should not decrease immediately after initiating closure
06:23:55 INFO - TEST-PASS | /webrtc/RTCDataChannel-bufferedAmount.html | bufferedAmount should not decrease after closing the peer connection
06:23:55 INFO - TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamountlow event fires after send() is complete - Test timed out
06:23:55 INFO -
06:23:55 INFO - TEST-UNEXPECTED-NOTRUN | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamount is data.length on send(data) - expected PASS
06:23:55 INFO -
06:23:55 INFO - TEST-UNEXPECTED-NOTRUN | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamount returns the same amount if no more data is sent on the channel - expected PASS
06:23:55 INFO -
06:23:55 INFO - TEST-UNEXPECTED-NOTRUN | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamountlow event fires only once after multiple consecutive send() calls - expected PASS
06:23:55 INFO -
06:23:55 INFO - TEST-UNEXPECTED-NOTRUN | /webrtc/RTCDataChannel-bufferedAmount.html | Data channel bufferedamountlow event fires after each sent message - expected PASS
06:23:55 INFO - TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCDataChannel-bufferedAmount.html | expected OK
06:23:55 INFO - TEST-INFO took 41241ms

Comment 1

[Intermittent Failures Robot]

21 failures in 4705 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 21

Platform breakdown:

• windows10-aarch64: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 2

[Intermittent Failures Robot]

14 failures in 4658 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14

Platform breakdown:

• windows10-aarch64: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 3

[Intermittent Failures Robot]

4 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• windows10-aarch64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 4

[Intermittent Failures Robot]

8 failures in 4337 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 8

Platform breakdown:

• windows10-aarch64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 5

[Intermittent Failures Robot]

11 failures in 5197 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11

Platform breakdown:

• windows10-aarch64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 6

[Byron Campen [:bwc]]

Maybe we should mark this test as long; it requires ICE to complete in a number of test cases.

Comment 7

[Byron Campen [:bwc]]

Attachment: Bug 1550691: Mark this test as long, because it requires ICE to complete. r?jib

Comment 8

[Byron Campen [:bwc]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=3f555d7cc7116f12c407f78fe364daf89f5693bc

Comment 9

[Intermittent Failures Robot]

13 failures in 4753 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 13

Platform breakdown:

• windows10-aarch64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 10

[Byron Campen [:bwc]]

Bug 1558851 just landed, which marked this test as expected to fail on aarch64. I need to rebase once that change makes it to central, and see if we can re-enable those test-cases.

Comment 11

[Byron Campen [:bwc]]

Attachment: Bug 1550691: Re-enable this test on aarch64.

Depends on D34356

Comment 12

[Byron Campen [:bwc]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=89229601e0dee4e9563041b6d548e0bdadb0db2b

Comment 13

[Intermittent Failures Robot]

9 failures in 2581 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 9

Platform breakdown:

• windows10-aarch64: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 14

[Intermittent Failures Robot]

15 failures in 4409 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 15

Platform breakdown:

• windows10-aarch64: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 15

[Byron Campen [:bwc]]

Seeing an assertion on test-verify on Win 7:

17:34:40 INFO - Crash reason: EXCEPTION_BREAKPOINT
17:34:40 INFO - Crash address: 0x559046ce
17:34:40 INFO - Assertion: Unknown assertion type 0x00000000
17:34:40 INFO - Process uptime: 5 seconds
17:34:40 INFO -
17:34:40 INFO - Thread 12 (crashed)
17:34:40 INFO - 0 xul.dll!mozilla::DataChannelConnection::DestroyOnSTSFinal() [DataChannel.cpp:89229601e0dee4e9563041b6d548e0bdadb0db2b : 378 + 0x29]
17:34:40 INFO - eip = 0x559046ce esp = 0x0600ea84 ebp = 0x0600ea84 ebx = 0x00000000
17:34:40 INFO - esi = 0x0600ea8c edi = 0x55904690 eax = 0x6c8926dc ecx = 0x00000095
17:34:40 INFO - edx = 0x00000049 efl = 0x00000206
17:34:40 INFO - Found by: given as instruction pointer in context
17:34:40 INFO - 1 xul.dll!nsresult mozilla::runnable_args_memfn<RefPtr<mozilla::DataChannelConnection>,void (mozilla::DataChannelConnection::*)() attribute((thiscall))>::Run() [runnable_utils.h:89229601e0dee4e9563041b6d548e0bdadb0db2b : 148 + 0x9]
17:34:40 INFO - eip = 0x5590fd71 esp = 0x0600ea8c ebp = 0x0600eab4
17:34:40 INFO - Found by: call frame info

Looks like a low-frequency, pre-existing bug to me. Retriggering to see...

Comment 16

[Byron Campen [:bwc]]

Also, that try push didn't run aarch64 for some reason.

Comment 17

[Byron Campen [:bwc]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=9fe00af0c613e71b69a7ff445af8ca943e32fbdc

Comment 18

[Byron Campen [:bwc]]

Try looks good so far, but retriggering to verify.

Comment 19

[Byron Campen [:bwc]]

Wow, those retriggers have been pending for a long time.

Comment 20

[Intermittent Failures Robot]

12 failures in 3501 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 12

Platform breakdown:

• windows10-aarch64: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 21

[Byron Campen [:bwc]]

Awesome, the retriggers never ran. Retriggering again...

Comment 22

[Byron Campen [:bwc]]

Ok, it looks like we're still getting timeouts in this test on other test-cases, so marking this as "long" is something we definitely need to do. On top of that, the ini file means that we always expect a timeout, which hints that the timeout is pretty consistent, so a clean try push without retriggers is good enough for me.

Comment 23

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/88f4378ccf1a
Mark this test as long, because it requires ICE to complete. r=jib
https://hg.mozilla.org/integration/autoland/rev/813fc70ec1f2
Re-enable this test on aarch64. r=jib

Comment 24

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/88f4378ccf1a
https://hg.mozilla.org/mozilla-central/rev/813fc70ec1f2

Comment 25

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/17764 for changes under testing/web-platform/tests

Comment 26

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged

Comment 27

[Intermittent Failures Robot]

2 failures in 4710 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-aarch64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1550691&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 28

[Byron Campen [:bwc]]

No failures since this landed, but low frequency. I'll check back next week.

Comment 29

[Byron Campen [:bwc]]

Yeah, this looks fixed.