1201209 - Intermittent test_nr_socket_unittest | test failed with return code 1

Status: RESOLVED FIXED

(Core :: WebRTC, defect, P2)

Description

[Ryan VanderMeulen [:RyanVM]]

07:33:44 INFO - TEST-START | test_nr_socket_unittest
07:33:48 INFO - PROCESS | test_nr_socket_unittest |
07:33:48 INFO - [WARNING: nsSocketTransportService::UpdatePrefs not implemented: file /builds/slave/fx-team-and-api-11-d-000000000/build/src/netwerk/base/nsSocketTransportService2.cpp, line 1159
07:33:48 INFO - [==========] Running 13 tests from 1 test case.
07:33:48 INFO - [----------] Global test environment set-up.
07:33:48 INFO - [----------] 13 tests from TestNrSocketTest
07:33:48 INFO - [ RUN ] TestNrSocketTest.PublicConnectivity
07:33:48 INFO - [ OK ] TestNrSocketTest.PublicConnectivity (157 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.PrivateConnectivity
07:33:48 INFO - [ OK ] TestNrSocketTest.PrivateConnectivity (151 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.NoConnectivityWithoutPinhole
07:33:48 INFO - [ OK ] TestNrSocketTest.NoConnectivityWithoutPinhole (80 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.NoConnectivityBetweenSubnets
07:33:48 INFO - [ OK ] TestNrSocketTest.NoConnectivityBetweenSubnets (178 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.FullConeAcceptIngress
07:33:48 INFO - [ OK ] TestNrSocketTest.FullConeAcceptIngress (114 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.FullConeOnePinhole
07:33:48 INFO - [ OK ] TestNrSocketTest.FullConeOnePinhole (115 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.RestrictedCone
07:33:48 INFO - [ OK ] TestNrSocketTest.RestrictedCone (168 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.PortDependentMappingFullCone
07:33:48 INFO - [ OK ] TestNrSocketTest.PortDependentMappingFullCone (215 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.Symmetric
07:33:48 INFO - [ OK ] TestNrSocketTest.Symmetric (295 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.BlockUdp
07:33:48 INFO - /builds/slave/fx-team-and-api-11-d-000000000/build/src/media/mtransport/test/test_nr_socket_unittest.cpp:575: Failure
07:33:48 INFO - Value of: CheckConnectivity(private_addrs_[0], private_addrs_[1])
07:33:48 INFO - Actual: false
07:33:48 INFO - Expected: true
07:33:48 INFO - [ FAILED ] TestNrSocketTest.BlockUdp (719 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.DenyHairpinning
07:33:48 INFO - [ OK ] TestNrSocketTest.DenyHairpinning (103 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.AllowHairpinning
07:33:48 INFO - [ OK ] TestNrSocketTest.AllowHairpinning (83 ms)
07:33:48 INFO - [ RUN ] TestNrSocketTest.FullConeTimeout
07:33:48 INFO - [ OK ] TestNrSocketTest.FullConeTimeout (306 ms)
07:33:48 INFO - [----------] 13 tests from TestNrSocketTest (2730 ms total)
07:33:48 INFO - [----------] Global test environment tear-down
07:33:48 INFO - [==========] 13 tests from 1 test case ran. (2748 ms total)
07:33:48 INFO - [ PASSED ] 12 tests.
07:33:48 INFO - [ FAILED ] 1 test, listed below:
07:33:48 INFO - [ FAILED ] TestNrSocketTest.BlockUdp
07:33:48 INFO - 1 FAILED TEST
07:33:48 INFO - YOU HAVE 1 DISABLED TEST
07:33:49 WARNING - TEST-UNEXPECTED-FAIL | test_nr_socket_unittest | test failed with return code 1
07:33:49 INFO - TEST-INFO took 4607ms

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4512597
repository: fx-team
start_time: 2015-09-02T07:07:48
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-018
buildname: Android 4.3 armv7 API 11+ fx-team debug test cppunit
revision: 2fa46d1de9bf

TEST-UNEXPECTED-FAIL | test_nr_socket_unittest | test failed with return code 1
Return code: 1
No tests run or test summary not found

Comment 2

[Byron Campen [:bwc]]

The long run time for that test suggests that we may have hit a timeout here:

https://dxr.mozilla.org/mozilla-central/source/media/mtransport/test/test_nr_socket_unittest.cpp?case=true&from=WaitForSocketState#228

I can extend this timeout.

Comment 3

[Byron Campen [:bwc]]

Attachment: MozReview Request: Bug 1201209: Extend the timeout on socket readiness in test_nr_socket_unittest. r?drno

Bug 1201209: Extend the timeout on socket readiness in test_nr_socket_unittest. r?drno

Comment 4

[Nils Ohlmeier [:drno]]

Comment on attachment 8656158 [details]
MozReview Request: Bug 1201209: Extend the timeout on socket readiness in test_nr_socket_unittest. r?drno

https://reviewboard.mozilla.org/r/18099/#review16209

Comment 5

[Byron Campen [:bwc]]

Check back on try.

Comment 6

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/6ebbe5ee0e81

Comment 7

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/6ebbe5ee0e81

Comment 8

[Intermittent Failures Robot]

6 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 3
* fx-team: 3

Platform breakdown:
* osx-10-6: 6

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1201209&startday=2016-02-01&endday=2016-02-07&tree=all

Comment 9

[Intermittent Failures Robot]

7 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 1
* fx-team: 1

Platform breakdown:
* osx-10-6: 6
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1201209&startday=2016-02-22&endday=2016-02-28&tree=all

Comment 10

[Byron Campen [:bwc]]

Not seeing anything of ours (media/mtransport) that landed in the right timeframe to cause this. I do see some necko stuff landing at about the right time, particularly the backout and initial landing of bug 698882.

Comment 11

[Byron Campen [:bwc]]

Retriggered this: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=6183d3a293a9

and this: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=08d7af2bfe30

Let's see what happens.

Comment 12

[Byron Campen [:bwc]]

Check back on this.

Comment 13

[Intermittent Failures Robot]

7 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 1
* fx-team: 1

Platform breakdown:
* osx-10-6: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1201209&startday=2016-02-29&endday=2016-03-06&tree=all

Comment 14

[Byron Campen [:bwc]]

Hmm, I tried landing this with reviewboard, and it thinks it landed, but it never did.

Comment 15

[Byron Campen [:bwc]]

Actually, scratch that, found it.

Comment 16

[Byron Campen [:bwc]]

No failures since changeset 6ebbe5ee0e81 landed.