1625080 - Intermittent LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp

Status: RESOLVED INCOMPLETE

(Core :: WebRTC: Signaling, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=294814920&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bIM1BifqSgO2-VsWjMhwcg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-03-26T05:18:09.665Z] 05:18:09     INFO - TEST-OK | /webrtc/simplecall.https.html | took 2738ms
[task 2020-03-26T05:18:09.721Z] 05:18:09     INFO - PID 25495 | 1585199889717	Marionette	INFO	Stopped listening on port 42690
[task 2020-03-26T05:18:10.152Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2014: CloseInt: Closing PeerConnectionImpl f6a9a3a5130fa219; ending call
[task 2020-03-26T05:18:10.152Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/jsep [1585199888533249 (id=173946175490 url=https://web-platform.test:8443/webrtc/simplecall.https.html)]: stable -> closed
[task 2020-03-26T05:18:10.168Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: E/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2612: GetStats: Found no pipelines matching selector.
[task 2020-03-26T05:18:10.169Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2014: CloseInt: Closing PeerConnectionImpl 3461f27d18d26c92; ending call
[task 2020-03-26T05:18:10.169Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/jsep [1585199888647555 (id=173946175490 url=https://web-platform.test:8443/webrtc/simplecall.https.html)]: stable -> closed
[task 2020-03-26T05:18:10.185Z] 05:18:10     INFO - PID 25495 | [Child 32458: WebRTCPD #1]: E/signaling [WebRTCPD #1|WebrtcAudioSessionConduit] AudioConduit.cpp:597: SendAudioFrame Engine not transmitting
[task 2020-03-26T05:18:10.222Z] 05:18:10     INFO - PID 25495 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-03-26T05:18:10.258Z] 05:18:10     INFO - PID 25495 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-03-26T05:18:10.478Z] 05:18:10     INFO - PID 25495 | Timecard created 1585199888.528345
[task 2020-03-26T05:18:10.478Z] 05:18:10     INFO - PID 25495 |  Timestamp   | Delta       | Event                          | File                         | Function
[task 2020-03-26T05:18:10.478Z] 05:18:10     INFO - PID 25495 | ======================================================================================================================
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.000126 |    0.000126 | Constructor Completed          | PeerConnectionImpl.cpp:326   | PeerConnectionImpl
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.004961 |    0.004835 | Initializing PC Ctx            | PeerConnectionImpl.cpp:452   | Initialize
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.074788 |    0.069827 | Create Offer                   | PeerConnectionImpl.cpp:1219  | CreateOffer
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.145392 |    0.070604 | Set Local Description          | PeerConnectionImpl.cpp:1288  | SetLocalDescription
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.195736 |    0.050344 | Set Remote Description         | PeerConnectionImpl.cpp:1375  | SetRemoteDescription
[task 2020-03-26T05:18:10.482Z] 05:18:10     INFO - PID 25495 |     0.263856 |    0.068120 | Ice gathering state: gathering | PeerConnectionImpl.cpp:2416  | IceGatheringStateChange
[task 2020-03-26T05:18:10.483Z] 05:18:10     INFO - PID 25495 |     0.279095 |    0.015239 | Ice gathering state: complete  | PeerConnectionImpl.cpp:2419  | IceGatheringStateChange
[task 2020-03-26T05:18:10.483Z] 05:18:10     INFO - PID 25495 |     0.291454 |    0.012359 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.486Z] 05:18:10     INFO - PID 25495 |     0.301210 |    0.009756 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.486Z] 05:18:10     INFO - PID 25495 |     0.303033 |    0.001823 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.486Z] 05:18:10     INFO - PID 25495 |     0.366597 |    0.063564 | Ice state: checking            | PeerConnectionImpl.cpp:2361  | IceConnectionStateChange
[task 2020-03-26T05:18:10.486Z] 05:18:10     INFO - PID 25495 |     0.384142 |    0.017545 | Ice state: connected           | PeerConnectionImpl.cpp:2364  | IceConnectionStateChange
[task 2020-03-26T05:18:10.490Z] 05:18:10     INFO - PID 25495 |     1.936888 |    1.552746 | Destructor Invoked             | PeerConnectionImpl.cpp:335   | ~PeerConnectionImpl
[task 2020-03-26T05:18:10.490Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: E/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:356: PeerConnectionCtx is already gone. Ignoring...
[task 2020-03-26T05:18:10.491Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:360: ~PeerConnectionImpl: PeerConnectionImpl destructor invoked for f6a9a3a5130fa219
[task 2020-03-26T05:18:10.491Z] 05:18:10     INFO - PID 25495 | Timecard created 1585199888.646346
[task 2020-03-26T05:18:10.496Z] 05:18:10     INFO - PID 25495 |  Timestamp   | Delta       | Event                          | File                         | Function
[task 2020-03-26T05:18:10.496Z] 05:18:10     INFO - PID 25495 | ======================================================================================================================
[task 2020-03-26T05:18:10.497Z] 05:18:10     INFO - PID 25495 |     0.000076 |    0.000076 | Constructor Completed          | PeerConnectionImpl.cpp:326   | PeerConnectionImpl
[task 2020-03-26T05:18:10.497Z] 05:18:10     INFO - PID 25495 |     0.001257 |    0.001181 | Initializing PC Ctx            | PeerConnectionImpl.cpp:452   | Initialize
[task 2020-03-26T05:18:10.497Z] 05:18:10     INFO - PID 25495 |     0.009947 |    0.008690 | Set Remote Description         | PeerConnectionImpl.cpp:1375  | SetRemoteDescription
[task 2020-03-26T05:18:10.503Z] 05:18:10     INFO - PID 25495 |     0.066633 |    0.056686 | Create Answer                  | PeerConnectionImpl.cpp:1250  | CreateAnswer
[task 2020-03-26T05:18:10.503Z] 05:18:10     INFO - PID 25495 |     0.088343 |    0.021710 | Set Local Description          | PeerConnectionImpl.cpp:1288  | SetLocalDescription
[task 2020-03-26T05:18:10.504Z] 05:18:10     INFO - PID 25495 |     0.170452 |    0.082109 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.505Z] 05:18:10     INFO - PID 25495 |     0.170915 |    0.000463 | Ice gathering state: gathering | PeerConnectionImpl.cpp:2416  | IceGatheringStateChange
[task 2020-03-26T05:18:10.505Z] 05:18:10     INFO - PID 25495 |     0.178218 |    0.007303 | Ice gathering state: complete  | PeerConnectionImpl.cpp:2419  | IceGatheringStateChange
[task 2020-03-26T05:18:10.506Z] 05:18:10     INFO - PID 25495 |     0.182279 |    0.004061 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.507Z] 05:18:10     INFO - PID 25495 |     0.184182 |    0.001903 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.508Z] 05:18:10     INFO - PID 25495 |     0.185892 |    0.001710 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.508Z] 05:18:10     INFO - PID 25495 |     0.187524 |    0.001632 | Add Ice Candidate              | PeerConnectionImpl.cpp:1513  | AddIceCandidate
[task 2020-03-26T05:18:10.509Z] 05:18:10     INFO - PID 25495 |     0.242094 |    0.054570 | Ice state: checking            | PeerConnectionImpl.cpp:2361  | IceConnectionStateChange
[task 2020-03-26T05:18:10.510Z] 05:18:10     INFO - PID 25495 |     0.274089 |    0.031995 | Ice state: connected           | PeerConnectionImpl.cpp:2364  | IceConnectionStateChange
[task 2020-03-26T05:18:10.510Z] 05:18:10     INFO - PID 25495 |     1.819479 |    1.545390 | Destructor Invoked             | PeerConnectionImpl.cpp:335   | ~PeerConnectionImpl
[task 2020-03-26T05:18:10.512Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: E/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:356: PeerConnectionCtx is already gone. Ignoring...
[task 2020-03-26T05:18:10.513Z] 05:18:10     INFO - PID 25495 | [Child 32458: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:360: ~PeerConnectionImpl: PeerConnectionImpl destructor invoked for 3461f27d18d26c92
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 | Suppressions used:
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 |   count      bytes template
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 |      27        832 nsComponentManagerImpl
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 |       2        288 libfontconfig.so
[task 2020-03-26T05:18:11.657Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.759Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.760Z] 05:18:11     INFO - PID 25495 | Suppressions used:
[task 2020-03-26T05:18:11.760Z] 05:18:11     INFO - PID 25495 |   count      bytes template
[task 2020-03-26T05:18:11.768Z] 05:18:11     INFO - PID 25495 |      27        832 nsComponentManagerImpl
[task 2020-03-26T05:18:11.768Z] 05:18:11     INFO - PID 25495 |     633      18287 libfontconfig.so
[task 2020-03-26T05:18:11.768Z] 05:18:11     INFO - PID 25495 |       1         11 libglib-2.0.so
[task 2020-03-26T05:18:11.768Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.846Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.846Z] 05:18:11     INFO - PID 25495 | Suppressions used:
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |   count      bytes template
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |      27        832 nsComponentManagerImpl
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |     633      18287 libfontconfig.so
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |       2      65568 nr_reg_local_init
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |     195      18592 r_log_register
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |      60       2761 nr_reg_set
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 |       1         11 libglib-2.0.so
[task 2020-03-26T05:18:11.847Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.964Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:11.965Z] 05:18:11     INFO - PID 25495 | Suppressions used:
[task 2020-03-26T05:18:11.965Z] 05:18:11     INFO - PID 25495 |   count      bytes template
[task 2020-03-26T05:18:11.965Z] 05:18:11     INFO - PID 25495 |      27        832 nsComponentManagerImpl
[task 2020-03-26T05:18:11.965Z] 05:18:11     INFO - PID 25495 |     633      18287 libfontconfig.so
[task 2020-03-26T05:18:11.966Z] 05:18:11     INFO - PID 25495 |       1         11 libglib-2.0.so
[task 2020-03-26T05:18:11.966Z] 05:18:11     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:13.496Z] 05:18:13     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:13.497Z] 05:18:13     INFO - PID 25495 | Suppressions used:
[task 2020-03-26T05:18:13.497Z] 05:18:13     INFO - PID 25495 |   count      bytes template
[task 2020-03-26T05:18:13.498Z] 05:18:13     INFO - PID 25495 |      24        728 nsComponentManagerImpl
[task 2020-03-26T05:18:13.498Z] 05:18:13     INFO - PID 25495 |     633      18083 libfontconfig.so
[task 2020-03-26T05:18:13.498Z] 05:18:13     INFO - PID 25495 |       1         11 libglib-2.0.so
[task 2020-03-26T05:18:13.498Z] 05:18:13     INFO - PID 25495 |       4        832 mozJSComponentLoader
[task 2020-03-26T05:18:13.498Z] 05:18:13     INFO - PID 25495 | -----------------------------------------------------
[task 2020-03-26T05:18:13.643Z] 05:18:13     INFO - Browser exited with return code 0
[task 2020-03-26T05:18:13.645Z] 05:18:13     INFO - PROCESS LEAKS None
[task 2020-03-26T05:18:13.645Z] 05:18:13     INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 300 byte(s) leaked in 3 allocation(s).
[task 2020-03-26T05:18:13.646Z] 05:18:13     INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2020-03-26T05:18:13.646Z] 05:18:13     INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2020-03-26T05:18:13.646Z] 05:18:13     INFO - Allowed depth was 4
[task 2020-03-26T05:18:13.648Z] 05:18:13     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2020-03-26T05:18:13.648Z] 05:18:13     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPacket::Copy, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2020-03-26T05:18:13.649Z] 05:18:13     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPipeline::MediaPipeline, mozilla::MediaPipelineReceive::MediaPipelineReceive, mozilla::MediaPipelineReceiveAudio::MediaPipelineReceiveAudio, mozilla::dom::RTCRtpReceiver::RTCRtpReceiver
[task 2020-03-26T05:18:13.652Z] 05:18:13     INFO - Closing logging queue
[task 2020-03-26T05:18:13.652Z] 05:18:13     INFO - queue closed
[task 2020-03-26T05:18:13.673Z] 05:18:13     INFO - INFO | runtests.py | ASan using symbolizer at /builds/worker/workspace/build/application/firefox/llvm-symbolizer
[task 2020-03-26T05:18:13.688Z] 05:18:13     INFO - LSan enabled.
[task 2020-03-26T05:18:13.689Z] 05:18:13     INFO - INFO | runtests.py | ASan running in default memory configuration
[task 2020-03-26T05:18:13.689Z] 05:18:13     INFO - UBSan enabled.
[task 2020-03-26T05:18:13.689Z] 05:18:13     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpDdzGMN
[task 2020-03-26T05:18:13.696Z] 05:18:13     INFO - PID 25873 | 1585199245354	[e-mail]	WARN	Loading extension '[e-mail]': Reading manifest: Invalid extension permission: networkStatus
[task 2020-03-26T05:18:13.696Z] 05:18:13     INFO - PID 25873 | 1585199249532	[e-mail]	WARN	Loading extension '[e-mail]': Reading manifest: Invalid extension permission: mozillaAddons
[task 2020-03-26T05:18:13.697Z] 05:18:13     INFO - PID 25873 | 1585199249533	[e-mail]	WARN	Loading extension '[e-mail]': Reading manifest: Invalid extension permission: telemetry
[task 2020-03-26T05:18:13.697Z] 05:18:13     INFO - PID 25873 | 1585199249535	[e-mail]	WARN	Loading extension '[e-mail]': Reading manifest: Invalid extension permission: resource://pdf.js/
[task 2020-03-26T05:18:13.697Z] 05:18:13     INFO - PID 25873 | 1585199249536	[e-mail]	WARN	Loading extension '[e-mail]': Reading manifest: Invalid extension permission: about:reader*
[task 2020-03-26T05:18:13.698Z] 05:18:13     INFO - PID 25873 | 1585199268760	Marionette	INFO	Listening on port 54235
[task 2020-03-26T05:18:13.698Z] 05:18:13     INFO - Starting runner
[task 2020-03-26T05:18:14.899Z] 05:18:14     INFO - TEST-START | /webrtc-identity/RTCPeerConnection-constructor.html
[task 2020-03-26T05:18:16.420Z] 05:18:16     INFO - .
[task 2020-03-26T05:18:16.420Z] 05:18:16     INFO - TEST-OK | /webrtc-identity/RTCPeerConnection-constructor.html | took 1522ms

Comment 1

[Byron Campen [:bwc]]

Looks like STS is never running this runnable, which is holding both the leaked MediaPacket and the leaked MediaPipeline: https://searchfox.org/mozilla-central/rev/4d9cd186767978a99dafe77eb536a9525980e118/media/webrtc/signaling/src/mediapipeline/MediaPipeline.cpp#1149

Also, there's this line from the logging:

[task 2020-03-26T05:18:10.512Z] 05:18:10 INFO - PID 25495 | [Child 32458: Main Thread]: E/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:356: PeerConnectionCtx is already gone. Ignoring...

This strongly hints that this is a leak on shutdown.

Comment 2

[Intermittent Failures Robot]

3 failures in 4773 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• try: 1
• autoland: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 3

[Intermittent Failures Robot]

6 failures in 5015 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 4

[Intermittent Failures Robot]

8 failures in 4823 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 5

[Intermittent Failures Robot]

11 failures in 4528 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-beta: 1
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 6

[Intermittent Failures Robot]

10 failures in 5582 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 3
• try: 1

Platform breakdown:

• linux1804-64-asan: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 7

[Intermittent Failures Robot]

5 failures in 5423 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 8

[Intermittent Failures Robot]

10 failures in 5276 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-beta: 2

Platform breakdown:

• linux1804-64-asan: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 9

[Intermittent Failures Robot]

5 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• try: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 4727 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 11

[Intermittent Failures Robot]

4 failures in 5458 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 12

[Intermittent Failures Robot]

2 failures in 4949 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 5211 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 4035 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 15

[Intermittent Failures Robot]

3 failures in 5252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 16

[Intermittent Failures Robot]

2 failures in 5265 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 17

[Intermittent Failures Robot]

3 failures in 4014 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 1
• mozilla-release: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 4289 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures in 3601 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 20

[Intermittent Failures Robot]

2 failures in 4046 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 21

[Intermittent Failures Robot]

3 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 22

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 23

[Cosmin Sabou [:CosminS]]

https://treeherder.mozilla.org/logviewer?job_id=320490383&repo=autoland

Comment 24

[Intermittent Failures Robot]

3 failures in 4128 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-esr78: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1625080&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 25

[Intermittent Failures Robot]

1 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures in 4810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 4060 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 28

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 29

[Intermittent Failures Robot]

1 failures in 2956 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 3891 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 31

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer?job_id=328877968&repo=mozilla-esr78&lineNumber=76429

Comment 32

[Intermittent Failures Robot]

1 failures in 3966 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 33

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 34

[Andreea Pavel [:apavel]]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=336226027&repo=mozilla-esr78&lineNumber=77150

[task 2021-04-12T17:12:48.689Z] 17:12:48 INFO - TEST-OK | /webrtc/idlharness.https.window.html | took 3161ms
[task 2021-04-12T17:12:48.690Z] 17:12:48 INFO - No more tests
[task 2021-04-12T17:12:48.690Z] 17:12:48 INFO - PID 11390 | 1618247568658 Marionette INFO Stopped listening on port 40022
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2025: CloseInt: Closing PeerConnectionImpl 10444ee37f1f28cc; ending call
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: I/jsep [1618247567615438 (id=169651208193 url=https://web-platform.test:8443/webrtc/idlharness.https.window.html)]: stable -> closed
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: I/signaling [main|PeerConnectionImpl] PeerConnectionImpl.cpp:2031: CloseInt: Destroying DataChannelConnection 0x6170000b3680 for 10444ee37f1f28cc
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: D/DataChannel Destroying DataChannelConnection 0x6170000b3680
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: D/DataChannel Closing all channels (connection 0x6170000b3680)
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: D/DataChannel DataChannelConnection labeled transport_0 (0x6170000b3680) switching connection state CONNECTING -> CLOSED
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: D/DataChannel Connection 0x6170000b3680/Channel 0x6110005fcac0: Closing stream 1
[task 2021-04-12T17:12:48.808Z] 17:12:48 INFO - PID 11390 | [Child 22254: Main Thread]: D/DataChannel Removing channel 1 : 0x6110005fcac0

[task 2021-04-12T17:12:51.245Z] 17:12:51 INFO - PID 11390 | -----------------------------------------------------
[task 2021-04-12T17:12:51.365Z] 17:12:51 INFO - Browser exited with return code 0
[task 2021-04-12T17:12:51.365Z] 17:12:51 INFO - PROCESS LEAKS None
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 276 byte(s) leaked in 3 allocation(s).
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - Allowed depth was 4
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPacket::Copy, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2021-04-12T17:12:51.366Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPipeline::MediaPipeline, mozilla::MediaPipelineReceive::MediaPipelineReceive, mozilla::MediaPipelineReceiveAudio::MediaPipelineReceiveAudio, mozilla::dom::RTCRtpReceiver::RTCRtpReceiver
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - Closing logging queue
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - queue closed
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - PROCESS LEAKS None
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - Allowed depth was 4
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at NS_NewRunnableFunction, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPacket::Copy, mozilla::MediaPipeline::PipelineTransport::SendRtcpPacket, mozilla::WebrtcAudioConduit::SendRtcp, webrtc::voe::Channel::SendRtcp
[task 2021-04-12T17:12:51.367Z] 17:12:51 INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::MediaPipeline::MediaPipeline, mozilla::MediaPipelineReceive::MediaPipelineReceive, mozilla::MediaPipelineReceiveAudio::MediaPipelineReceiveAudio, mozilla::dom::RTCRtpReceiver::RTCRtpReceiver
[task 2021-04-12T17:12:51.383Z] 17:12:51 INFO - Got 0 unexpected results
[task 2021-04-12T17:12:51.383Z] 17:12:51 INFO - SUITE-END | took 589s
[task 2021-04-12T17:12:51.431Z] 17:12:51 INFO - Removed font: Ahem.ttf
[task 2021-04-12T17:12:51.446Z] 17:12:51 INFO - Closing logging queue
[task 2021-04-12T17:12:51.446Z] 17:12:51 INFO - queue closed
[task 2021-04-12T17:12:51.632Z] 17:12:51 INFO - Return code: 0
[task 2021-04-12T17:12:51.633Z] 17:12:51 ERROR - Got 7 unexpected statuses
[task 2021-04-12T17:12:51.633Z] 17:12:51 WARNING - # TBPL WARNING #
[task 2021-04-12T17:12:51.633Z] 17:12:51 WARNING - setting return code to 1

Comment 35

[Intermittent Failures Robot]

1 failures in 4255 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 3224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-04-19&endday=2021-04-25&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 3706 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3279 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 40

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 41

[Sandor Molnar[:smolnar]]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=344409857&repo=autoland&lineNumber=6986

Comment 42

[Intermittent Failures Robot]

2 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 2224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-07-12&endday=2021-07-18&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 3131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 45

[Intermittent Failures Robot]

2 failures in 3025 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 46

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 47

[Intermittent Failures Robot]

1 failures in 3375 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 48

[Marian-Vasile Laza]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=353666984&repo=mozilla-central&lineNumber=5639

Comment 49

[Intermittent Failures Robot]

1 failures in 3626 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 50

[Intermittent Failures Robot]

1 failures in 3315 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-10-11&endday=2021-10-17&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 3186 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 2723 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1625080&startday=2021-11-08&endday=2021-11-14&tree=all

Comment 53

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.