1256201 - Intermittent gtest | test failed with return code 1 from various WebRtcIceConnectTest.TestSendReceiveTcp failures

Status: RESOLVED WORKSFORME

(Core :: WebRTC: Networking, defect, P4)

Description

[Ryan VanderMeulen [:RyanVM]]

https://treeherder.mozilla.org/logviewer.html#?job_id=3473829&repo=mozilla-central

19:16:55     INFO -  TEST-START | WebRtcIceConnectTest.TestSendReceiveTcp
19:16:55     INFO -  Candidate for stream P1:stream0 initialized: candidate:0 1 UDP 2122252543 10.26.56.120 55596 typ host
19:16:55     INFO -  Candidate for stream P1:stream0 initialized: candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive
19:16:55     INFO -  Candidate for stream P1:stream0 initialized: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Candidate for stream P1:stream0 initialized: candidate:2 1 TCP 2105491711 10.26.56.120 57047 typ host tcptype so
19:16:55     INFO -  Gathering complete for P1
19:16:55     INFO -  CANDIDATES:
19:16:55     INFO -  Stream P1
19:16:55     INFO -  candidate:0 1 UDP 2122252543 10.26.56.120 55596 typ host
19:16:55     INFO -  candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive
19:16:55     INFO -  candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  candidate:2 1 TCP 2105491711 10.26.56.120 57047 typ host tcptype so
19:16:55     INFO -  Candidate for stream P2:stream0 initialized: candidate:0 1 UDP 2122252543 10.26.56.120 62836 typ host
19:16:55     INFO -  Candidate for stream P2:stream0 initialized: candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive
19:16:55     INFO -  Candidate for stream P2:stream0 initialized: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Gathering complete for P2
19:16:55     INFO -  CANDIDATES:
19:16:55     INFO -  Stream P2
19:16:55     INFO -  candidate:0 1 UDP 2122252543 10.26.56.120 62836 typ host
19:16:55     INFO -  candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive
19:16:55     INFO -  candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Returning candidate: candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive
19:16:55     INFO -  Returning candidate: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Returning candidate: candidate:2 1 TCP 2105491711 10.26.56.120 57047 typ host tcptype so
19:16:55     INFO -  Candidate: candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive
19:16:55     INFO -  Candidate: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Candidate: candidate:2 1 TCP 2105491711 10.26.56.120 57047 typ host tcptype so
19:16:55     INFO -  ICE checking P2
19:16:55     INFO -  Returning candidate: candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive
19:16:55     INFO -  Returning candidate: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  Candidate: candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive
19:16:55     INFO -  Candidate: candidate:2 1 TCP 2105524479 10.26.56.120 9 typ host tcptype active
19:16:55     INFO -  ICE checking P1
19:17:02  WARNING -  TEST-UNEXPECTED-FAIL | WebRtcIceConnectTest.TestSendReceiveTcp | Value of: res
19:17:02     INFO -    Actual: false
19:17:02     INFO -  Expected: true @ /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/test/ice_unittest.cpp:1597
19:17:02     INFO -  insert 'ice' (registry) succeeded: ice
19:17:02     INFO -  insert 'ice.pref' (registry) succeeded: ice.pref
19:17:02     INFO -  insert 'ice.pref.type' (registry) succeeded: ice.pref.type
19:17:02     INFO -  insert 'ice.pref.type.srv_rflx' (UCHAR) succeeded: 0x64
19:17:02     INFO -  insert 'ice.pref.type.peer_rflx' (UCHAR) succeeded: 0x6e
19:17:02     INFO -  insert 'ice.pref.type.host' (UCHAR) succeeded: 0x7e
19:17:02     INFO -  insert 'ice.pref.type.relayed' (UCHAR) succeeded: 0x05
19:17:02     INFO -  insert 'ice.pref.type.srv_rflx_tcp' (UCHAR) succeeded: 0x63
19:17:02     INFO -  insert 'ice.pref.type.peer_rflx_tcp' (UCHAR) succeeded: 0x6d
19:17:02     INFO -  insert 'ice.pref.type.host_tcp' (UCHAR) succeeded: 0x7d
19:17:02     INFO -  insert 'ice.pref.type.relayed_tcp' (UCHAR) succeeded: 0x00
19:17:02     INFO -  insert 'stun' (registry) succeeded: stun
19:17:02     INFO -  insert 'stun.client' (registry) succeeded: stun.client
19:17:02     INFO -  insert 'stun.client.maximum_transmits' (UINT4) succeeded: 7
19:17:02     INFO -  insert 'ice.trickle_grace_period' (UINT4) succeeded: 5000
19:17:02     INFO -  insert 'ice.tcp' (registry) succeeded: ice.tcp
19:17:02     INFO -  insert 'ice.tcp.so_sock_count' (INT4) succeeded: 3
19:17:02     INFO -  insert 'ice.tcp.listen_backlog' (INT4) succeeded: 10
19:17:02     INFO -  insert 'ice.tcp.disable' (char) succeeded: \000
19:17:02     INFO -  ICE(P1): No STUN servers specified
19:17:02     INFO -  ICE(P1): No TURN servers specified
19:17:02     INFO -  ICE(P2): No STUN servers specified
19:17:02     INFO -  ICE(P2): No TURN servers specified
19:17:02     INFO -  /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/third_party/nICEr/src/net/nr_socket_multi_tcp.c:173 function nr_socket_multi_tcp_create_stun_server_socket skipping UDP STUN server(addr:)
19:17:02     INFO -  /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/third_party/nICEr/src/net/nr_socket_multi_tcp.c:173 function nr_socket_multi_tcp_create_stun_server_socket skipping UDP STUN server(addr:)
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:55596/UDP|:3478)): Can't use DNS names without a resolver
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:56362/TCP|:3478) passive): Can't use DNS names without a resolver
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:57047/TCP|:3478) so): Can't use DNS names without a resolver
19:17:02     INFO -  /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/third_party/nICEr/src/net/nr_socket_multi_tcp.c:173 function nr_socket_multi_tcp_create_stun_server_socket skipping UDP STUN server(addr:)
19:17:02     INFO -  /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/third_party/nICEr/src/net/nr_socket_multi_tcp.c:173 function nr_socket_multi_tcp_create_stun_server_socket skipping UDP STUN server(addr:)
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:62836/UDP|:3478)): Can't use DNS names without a resolver
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:62938/TCP|:3478) passive): Can't use DNS names without a resolver
19:17:02     INFO -  ICE-CANDIDATE(srflx(IP4:10.26.56.120:62938/TCP|:3478) so): Can't use DNS names without a resolver
19:17:02     INFO -  ICE-PEER(P2:default)/CAND-PAIR(/KIm): setting pair to state FROZEN: /KIm|IP4:10.26.56.120:52457/TCP|IP4:10.26.56.120:56362/TCP(host(IP4:10.26.56.120:52457/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive)
19:17:02     INFO -  ICE(P2)/CAND-PAIR(/KIm): Pairing candidate IP4:10.26.56.120:52457/TCP (7d7fc0ff):IP4:10.26.56.120:56362/TCP (7d7f80ff) priority=9043088413699310079 (7d7f80fffaff81ff)
19:17:02     INFO -  ICE-PEER(P2:default)/CAND-PAIR(/KIm): setting pair to state WAITING: /KIm|IP4:10.26.56.120:52457/TCP|IP4:10.26.56.120:56362/TCP(host(IP4:10.26.56.120:52457/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive)
19:17:02     INFO -  ICE-PEER(P2:default)/ICE-STREAM(P2:stream0): Starting check timer for stream.
19:17:02     INFO -  ICE-PEER(P2:default)/CAND-PAIR(/KIm): setting pair to state IN_PROGRESS: /KIm|IP4:10.26.56.120:52457/TCP|IP4:10.26.56.120:56362/TCP(host(IP4:10.26.56.120:52457/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 56362 typ host tcptype passive)
19:17:02     INFO -  Write buffer not empty for IP4:10.26.56.120:56362/TCP  98 - already armed (@0x1208614e4), not connected
19:17:02     INFO -  ICE(P2): peer (P2:default) is now checking
19:17:02     INFO -  ICE(P2): peer (P2:default) no streams with pre-answer requests
19:17:02     INFO -  ICE-PEER(P1:default)/CAND-PAIR(cDy0): setting pair to state FROZEN: cDy0|IP4:10.26.56.120:60144/TCP|IP4:10.26.56.120:62938/TCP(host(IP4:10.26.56.120:60144/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive)
19:17:02     INFO -  ICE(P1)/CAND-PAIR(cDy0): Pairing candidate IP4:10.26.56.120:60144/TCP (7d7fc0ff):IP4:10.26.56.120:62938/TCP (7d7f80ff) priority=9043088413699310078 (7d7f80fffaff81fe)
19:17:02     INFO -  ICE-PEER(P1:default)/CAND-PAIR(cDy0): setting pair to state WAITING: cDy0|IP4:10.26.56.120:60144/TCP|IP4:10.26.56.120:62938/TCP(host(IP4:10.26.56.120:60144/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive)
19:17:02     INFO -  ICE-PEER(P1:default)/ICE-STREAM(P1:stream0): Starting check timer for stream.
19:17:02     INFO -  ICE-PEER(P1:default)/CAND-PAIR(cDy0): setting pair to state IN_PROGRESS: cDy0|IP4:10.26.56.120:60144/TCP|IP4:10.26.56.120:62938/TCP(host(IP4:10.26.56.120:60144/TCP) active|candidate:2 1 TCP 2105508095 10.26.56.120 62938 typ host tcptype passive)
19:17:02     INFO -  Write buffer not empty for IP4:10.26.56.120:62938/TCP  102 - already armed (@0x1208617e4), not connected
19:17:02     INFO -  ICE(P1): peer (P1:default) is now checking
19:17:02     INFO -  ICE(P1): peer (P1:default) no streams with pre-answer requests
19:17:02     INFO -  ICE-PEER(P2:default): no pairs for P2:stream0
19:17:02     INFO -  ICE-PEER(P1:default): no pairs for P1:stream0
19:17:02     INFO -  ICE(P2): peer (P2:default) Trickle grace period is over; marking every component with only failed pairs as failed.
19:17:02     INFO -  ICE(P1): peer (P1:default) Trickle grace period is over; marking every component with only failed pairs as failed.
19:17:02  WARNING -  TEST-UNEXPECTED-FAIL | WebRtcIceConnectTest.TestSendReceiveTcp | Value of: NS_SUCCEEDED(streams_[stream]->SendPacket(component, data, len))
19:17:02     INFO -    Actual: false
19:17:02     INFO -  Expected: true @ /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/test/ice_unittest.cpp:1163
19:17:02  WARNING -  TEST-UNEXPECTED-FAIL | WebRtcIceConnectTest.TestSendReceiveTcp | Value of: p1_->sent()
19:17:02     INFO -    Actual: 0
19:17:02     INFO -  Expected: 1u
19:17:02     INFO -  Which is: 1 @ /builds/slave/m-cen-m64-00000000000000000000/build/src/media/mtransport/test/ice_unittest.cpp:1694
19:17:04  WARNING -  TEST-UNEXPECTED-FAIL | WebRtcIceConnectTest.TestSendReceiveTcp | test completed (time: 9015ms)

Comment 1

[Nils Ohlmeier [:drno]]

Looks like both PeerConnection's try connect from their active socket to the passive socket from the other PC, but neither succeeds.
The only other thing I noticed is that P2 fails to gather an SO socket. Not sure if that is related in any way.

Comment 2

[Intermittent Failures Robot]

1 failures in 814 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-06-12&endday=2017-06-18&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 656 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* osx-cross: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 6

[Bulk Bug Changes for mreavy's org]

Mass change P3->P4 to align with new Mozilla triage process.

Comment 7

[Intermittent Failures Robot]

2 failures in 824 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* osx-10-10: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 947 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 912 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 744 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1256201&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 4045 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1256201&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 5336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1256201&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 5252 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1256201&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 4516 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1256201&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 4195 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1256201&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 16

[Intermittent Failures Robot]

2 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1
• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1256201&startday=2021-07-05&endday=2021-07-11&tree=all