1762911 - Intermittent LeakSanitizer | leak at mozilla::net::AddStaticElement, AddStaticElement, InitializeStaticHeaders, mozilla::net::nvFIFO::nvFIFO

Status: RESOLVED FIXED

(Core :: Networking: HTTP, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=373266187&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KjgtngrmT_ydlCKUGoG7-Q/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-04-04T12:25:33.406Z] 12:25:33     INFO - PID 18606 | Direct leak of 32 byte(s) in 1 object(s) allocated from:
[task 2022-04-04T12:25:33.406Z] 12:25:33     INFO - PID 18606 |     #0 0x557fd54a2e6d in malloc /builds/worker/fetches/llvm-project/compiler-rt/lib/asan/asan_malloc_linux.cpp:129:3
[task 2022-04-04T12:25:33.407Z] 12:25:33     INFO - PID 18606 |     #1 0x557fd54ddd1d in moz_xmalloc /builds/worker/checkouts/gecko/memory/mozalloc/mozalloc.cpp:52:15
[task 2022-04-04T12:25:33.407Z] 12:25:33     INFO - PID 18606 |     #2 0x7fcc4c095999 in operator new /builds/worker/workspace/obj-build/dist/include/mozilla/cxxalloc.h:33:10
[task 2022-04-04T12:25:33.408Z] 12:25:33     INFO - PID 18606 |     #3 0x7fcc4c095999 in mozilla::net::AddStaticElement(nsTString<char> const&, nsTString<char> const&) /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Compression.cpp:96:18
[task 2022-04-04T12:25:33.408Z] 12:25:33     INFO - PID 18606 |     #4 0x7fcc4c0183af in InitializeStaticHeaders /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Compression.cpp:115:5
[task 2022-04-04T12:25:33.409Z] 12:25:33     INFO - PID 18606 |     #5 0x7fcc4c0183af in mozilla::net::nvFIFO::nvFIFO() /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Compression.cpp:183:20
[task 2022-04-04T12:25:33.409Z] 12:25:33     INFO - PID 18606 |     #6 0x7fcc4c01b9d3 in mozilla::net::Http2BaseCompressor::Http2BaseCompressor() /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Compression.cpp:234:22
[task 2022-04-04T12:25:33.410Z] 12:25:33     INFO - PID 18606 |     #7 0x7fcc4c03aabd in mozilla::net::Http2Compressor::Http2Compressor() /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Compression.h:155:3
[task 2022-04-04T12:25:33.410Z] 12:25:33     INFO - PID 18606 |     #8 0x7fcc4c039ab5 in mozilla::net::Http2Session::Http2Session(nsISocketTransport*, mozilla::net::SpdyVersion, bool) /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Session.cpp:110:15
[task 2022-04-04T12:25:33.411Z] 12:25:33     INFO - PID 18606 |     #9 0x7fcc4c0389db in mozilla::net::Http2Session::CreateSession(nsISocketTransport*, mozilla::net::SpdyVersion, bool) /builds/worker/checkouts/gecko/netwerk/protocol/http/Http2Session.cpp:105:11
[task 2022-04-04T12:25:33.411Z] 12:25:33     INFO - PID 18606 |     #10 0x7fcc4c24347a in mozilla::net::nsHttpConnection::StartSpdy(nsISSLSocketControl*, mozilla::net::SpdyVersion) /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnection.cpp:292:9
[task 2022-04-04T12:25:33.412Z] 12:25:33     INFO - PID 18606 |     #11 0x7fcc4c259c1f in mozilla::net::nsHttpConnection::HandshakeDoneInternal() /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnection.cpp
[task 2022-04-04T12:25:33.412Z] 12:25:33     INFO - PID 18606 |     #12 0x7fcc4c2c9a5a in operator() /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnection.cpp:2543:19
[task 2022-04-04T12:25:33.413Z] 12:25:33     INFO - PID 18606 |     #13 0x7fcc4c2c9a5a in mozilla::detail::RunnableFunction<mozilla::net::nsHttpConnection::HandshakeDone()::$_0>::Run() /builds/worker/workspace/obj-build/dist/include/nsThreadUtils.h:531:5
[task 2022-04-04T12:25:33.413Z] 12:25:33     INFO - PID 18606 |     #14 0x7fcc4b4b41cf in nsThread::ProcessNextEvent(bool, bool*) /builds/worker/checkouts/gecko/xpcom/threads/nsThread.cpp:1181:16
[task 2022-04-04T12:25:33.413Z] 12:25:33     INFO - PID 18606 |     #15 0x7fcc4b4bd98c in NS_ProcessNextEvent(nsIThread*, bool) /builds/worker/checkouts/gecko/xpcom/threads/nsThreadUtils.cpp:465:10
[task 2022-04-04T12:25:33.414Z] 12:25:33     INFO - PID 18606 |     #16 0x7fcc4b86f8f1 in mozilla::net::nsSocketTransportService::Run() /builds/worker/checkouts/gecko/netwerk/base/nsSocketTransportService2.cpp:1202:11
[task 2022-04-04T12:25:33.414Z] 12:25:33     INFO - PID 18606 |     #17 0x7fcc4b87154c in non-virtual thunk to mozilla::net::nsSocketTransportService::Run() /builds/worker/checkouts/gecko/netwerk/base/nsSocketTransportService2.cpp
[task 2022-04-04T12:25:33.415Z] 12:25:33     INFO - PID 18606 |     #18 0x7fcc4b4b41cf in nsThread::ProcessNextEvent(bool, bool*) /builds/worker/checkouts/gecko/xpcom/threads/nsThread.cpp:1181:16
[task 2022-04-04T12:25:33.415Z] 12:25:33     INFO - PID 18606 |     #19 0x7fcc4b4bd98c in NS_ProcessNextEvent(nsIThread*, bool) /builds/worker/checkouts/gecko/xpcom/threads/nsThreadUtils.cpp:465:10
[task 2022-04-04T12:25:33.416Z] 12:25:33     INFO - PID 18606 |     #20 0x7fcc4c7978a8 in mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) /builds/worker/checkouts/gecko/ipc/glue/MessagePump.cpp:300:20
[task 2022-04-04T12:25:33.416Z] 12:25:33     INFO - PID 18606 |     #21 0x7fcc4c6a3061 in RunInternal /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:380:10
[task 2022-04-04T12:25:33.417Z] 12:25:33     INFO - PID 18606 |     #22 0x7fcc4c6a3061 in RunHandler /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:373:3
[task 2022-04-04T12:25:33.417Z] 12:25:33     INFO - PID 18606 |     #23 0x7fcc4c6a3061 in MessageLoop::Run() /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:355:3
[task 2022-04-04T12:25:33.418Z] 12:25:33     INFO - PID 18606 |     #24 0x7fcc4b4ac6fc in nsThread::ThreadFunc(void*) /builds/worker/checkouts/gecko/xpcom/threads/nsThread.cpp:385:10
[task 2022-04-04T12:25:33.418Z] 12:25:33     INFO - PID 18606 |     #25 0x7fcc6cba0ade in _pt_root /builds/worker/checkouts/gecko/nsprpub/pr/src/pthreads/ptthread.c:201:5
[task 2022-04-04T12:25:33.418Z] 12:25:33     INFO - PID 18606 |     #26 0x7fcc6e85d6da in start_thread /tmp/glibc/nptl/pthread_create.c:463
[task 2022-04-04T12:25:33.419Z] 12:25:33     INFO - PID 18606 | -----------------------------------------------------
[task 2022-04-04T12:25:33.419Z] 12:25:33     INFO - PID 18606 | Suppressions used:
[task 2022-04-04T12:25:33.420Z] 12:25:33     INFO - PID 18606 |   count      bytes template
[task 2022-04-04T12:25:33.420Z] 12:25:33     INFO - PID 18606 |       9        280 nsComponentManagerImpl
[task 2022-04-04T12:25:33.421Z] 12:25:33     INFO - PID 18606 |     631      18073 libfontconfig.so
[task 2022-04-04T12:25:33.421Z] 12:25:33     INFO - PID 18606 |       4      16407 libglib-2.0.so
[task 2022-04-04T12:25:33.421Z] 12:25:33     INFO - PID 18606 |       1        192 mozJSComponentLoader
[task 2022-04-04T12:25:33.421Z] 12:25:33     INFO - PID 18606 |       2         48 XPCWrappedNativeJSOps
[task 2022-04-04T12:25:33.422Z] 12:25:33     INFO - PID 18606 | -----------------------------------------------------
[task 2022-04-04T12:25:33.422Z] 12:25:33     INFO - PID 18606 | 1649075132911	geckodriver::browser	DEBUG	Browser process stopped: exit status: 0
[task 2022-04-04T12:25:33.423Z] 12:25:33     INFO - PID 18606 | 1649075132911	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2022-04-04T12:25:33.423Z] 12:25:33     INFO - PID 18606 | 1649075132930	webdriver::server	DEBUG	-> GET /status
[task 2022-04-04T12:25:33.423Z] 12:25:33     INFO - PID 18606 | 1649075132930	webdriver::server	DEBUG	<- 200 OK {"value":{"message":"","ready":true}}
[task 2022-04-04T12:25:33.424Z] 12:25:33     INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 1952 byte(s) leaked in 61 allocation(s).
[task 2022-04-04T12:25:33.424Z] 12:25:33     INFO - LeakSanitizer | To show the addresses of leaked objects add report_objects=1 to LSAN_OPTIONS
[task 2022-04-04T12:25:33.424Z] 12:25:33     INFO - This can be done in testing/mozbase/mozrunner/mozrunner/utils.py
[task 2022-04-04T12:25:33.424Z] 12:25:33     INFO - Allowed depth was 4
[task 2022-04-04T12:25:33.425Z] 12:25:33     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::net::AddStaticElement, AddStaticElement, InitializeStaticHeaders, mozilla::net::nvFIFO::nvFIFO
[task 2022-04-04T12:25:33.425Z] 12:25:33     INFO - TEST-UNEXPECTED-FAIL | LeakSanitizer | leak at mozilla::net::AddStaticElement, InitializeStaticHeaders, mozilla::net::nvFIFO::nvFIFO, mozilla::net::Http2BaseCompressor::Http2BaseCompressor
[task 2022-04-04T12:25:33.426Z] 12:25:33     INFO - Closing logging queue
[task 2022-04-04T12:25:33.427Z] 12:25:33     INFO - queue closed
[task 2022-04-04T12:25:33.869Z] 12:25:33     INFO - PID 18921 | 1649075133367	geckodriver	INFO	Listening on 127.0.0.1:53319
[task 2022-04-04T12:25:33.869Z] 12:25:33     INFO - Starting runner
[task 2022-04-04T12:25:34.122Z] 12:25:34     INFO - TEST-START | /_mozilla/webdriver/take_full_screenshot/iframe.py

Comment 1

[Intermittent Failures Robot]

16 failures in 634 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 5
• mozilla-release: 3
• mozilla-beta: 8

Platform and build breakdown:

• linux1804-64-asan-qr: 16
  • opt: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2022-04-04&endday=2022-04-04&tree=all

Comment 2

[Andreea Pavel [:apavel]]

All failures here are on beta/try.

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1755767

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

:dragana, since you are the author of the regressor, bug 1755767, could you take a look?
For more information, please visit auto_nag documentation.

Comment 5

[Intermittent Failures Robot]

31 failures in 2922 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 7
• mozilla-release: 3
• mozilla-beta: 21

Platform and build breakdown:

• linux1804-64-asan-qr: 31
  • opt: 31

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2022-04-04&endday=2022-04-10&tree=all

Comment 6

[Intermittent Failures Robot]

7 failures in 3289 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 7

Platform and build breakdown:

• linux1804-64-asan-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2022-04-25&endday=2022-05-01&tree=all

Comment 7

[Intermittent Failures Robot]

14 failures in 3317 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 9
• try: 5

Platform and build breakdown:

• linux1804-64-asan-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2022-05-09&endday=2022-05-15&tree=all

Comment 8

[Intermittent Failures Robot]

7 failures in 2694 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-beta: 2
• mozilla-release: 3

Platform and build breakdown:

• linux1804-64-asan-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2022-05-16&endday=2022-05-22&tree=all

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Dragana, when and where was it fixed? If you would have a reference that would be great. I'm asking because we recently had such a leak in a beta simulation for 107b12:

https://treeherder.mozilla.org/jobs?repo=try&revision=4cf345b958934c7a490bd1daddf217db9957e0a3&selectedTaskRun=M2aZJuB4Sm2XFYxw9eRf3g.0

Note that the wdspec issues are tracked via bug 1759310 whereby it's not happening that often anymore because we have exceptions for these leaks in place for now:

https://searchfox.org/mozilla-central/source/testing/web-platform/meta/webdriver/tests/__dir__.ini

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Reopening given that this is not fixed but only accepted via manifest files. Leaving needinfo for Dragana.

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Valentin maybe you could help here? Thanks a lot.

Comment 12

[Valentin Gosu [:valentin]]

Dragana has an idea how to fix this.

Comment 13

[Dragana Damjanovic [:dragana]]

Attachment: Bug 1762911 - Change how necko finishes TLS handshake

Currently, NSS calls the handshake completed callback function, HandshakeCallback from nsNSSCallbacks.cpp. HandshakeCallback calls nsNSSSocketInfo::SetHandshakeCompleted that calls TlsHandshaker::HandshakeDone. All of this is happening while NSS holds a lock. When a handshake is done, necko may need to finish setting up Http/2Session(in the nsHttpConnection::HandshakeDoneInternal) and for that it needs info from NSS, but NSS holds the lock and that is not possible. To resolve this problem necko sets TlsHandshakerTlsHandshaker::mTlsHandshakeComplitionPending to true and dispatches a runnable that will call nsHttpConnection::HandshakeDoneInternal). This dispatch causes bug 1762911, probably due to a shutdown happening just before the runnable is executed.

To resolve the issue and to better integrate HandshakeDoneInternal into necko we will do the following:
TlsHandshaker::HandshakeDone will set mTlsHandshakeComplitionPending to true and call nsHttpConnection::ForceSend. The nsHttpConnection::ForceSend function is a better way to force the handshake to be finished because it is taking already existing standard necko code paths.
nsHttpConnection::ForceSend calls nsHttoConnection::OnOutputStreamReady that will call TlsHandshaker::Ensure NPNComplete that will call nsHttpConnection::HandshakeDoneInternal.

Comment 14

[Dragana Damjanovic [:dragana]]

https://treeherder.mozilla.org/jobs?repo=try&revision=0c3de2e55919373fc8c28a264e455cdf24c85218

Comment 15

[Dragana Damjanovic [:dragana]]

The patch I have created does not resolve the issue. The leak still exists, but this time the stack is called from nsSockettransportService while iterating through sockets that are ready to read or write. This stack shows that the original theory is not entirely correct.

I have landed the patch that I created anyway because I think the patch is the more appropriate way to deal with this case.

Comment 16

[Dragana Damjanovic [:dragana]]

Marking the bug leave-open because the current patch does not fix the issue.

Comment 17

[Dragana Damjanovic [:dragana]]

This is the new trace referred in comment 15:
https://treeherder.mozilla.org/jobs?repo=try&revision=bce4777c3fce1e95470e24055a053072cb2da5c0&selectedTaskRun=ZVJyoAEGTJ6dTv-JPo5Yvw.0&group_state=expanded

Comment 18

[Dragana Damjanovic [:dragana]]

I will not have time to work on this bug, so I am unassigning myself.

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2c4c34f31021
Change how necko finishes TLS handshake r=necko-reviewers,kershaw

Comment 20

[Atila Butkovits]

Backed out for causing xpcshell failures at test_servers.js.

Backout link: https://hg.mozilla.org/integration/autoland/rev/9c5cc040ce0cda90686ed7218b508e8b1320ddc3

Push with failures: https://treeherder.mozilla.org/jobs?repo=autoland&selectedTaskRun=GxwnfgNgScKULdv6KkfobA.0&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&revision=2c4c34f3102184a5486d03685eb72228b0a438db

Failure log:
https://treeherder.mozilla.org/logviewer?job_id=393727028&repo=autoland&lineNumber=4003
https://treeherder.mozilla.org/logviewer?job_id=393742939&repo=autoland&lineNumber=2046

Comment 21

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Valentin, would someone of the necko team be able to continue this work including a fix for the crash which caused Dragana's patch to get backed out?

Comment 22

[Valentin Gosu [:valentin]]

Yes, I'll have a look.

Comment 23

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Thanks!

Comment 24

[Valentin Gosu [:valentin]]

Attachment: Bug 1762911 - SendConnectRequest should only be called when mState==SETTING_UP_TUNNEL r=#necko

mTlsHandshaker->EnsureNPNComplete() may change nsHttpConnection::mState.
Calling SendConnectRequest() requires that we are in the SETTING_UP_TUNNEL.
As such, we should move the call to EnsureNPNComplete, to ensure we never
call SendConnectRequest when mProxyConnectStream is null.

Depends on D159078

Comment 25

[BugBot [:suhaib / :marco/ :calixte]]

There are some r+ patches which didn't land and no activity in this bug for 2 weeks.
:valentin, could you have a look please?
If you still have some work to do, you can add an action "Plan Changes" in Phabricator.
For more information, please visit auto_nag documentation.

Comment 26

[Phabricator Automation]

Comment on attachment 9298055 [details]
Bug 1762911 - Change how necko finishes TLS handshake

Revision D159078 was moved to bug 1801292. Setting attachment 9298055 [details] to obsolete.

Comment 27

[Phabricator Automation]

Comment on attachment 9301295 [details]
Bug 1762911 - SendConnectRequest should only be called when mState==SETTING_UP_TUNNEL r=#necko

Revision D160892 was moved to bug 1801292. Setting attachment 9301295 [details] to obsolete.

Comment 29

[Intermittent Failures Robot]

3 failures in 3752 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 4161 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-03-20&endday=2023-03-26&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 4004 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 32

[Intermittent Failures Robot]

6 failures in 3177 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 3
• try: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 4
  • opt: 3
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-04-24&endday=2023-04-30&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 3411 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-05-01&endday=2023-05-07&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 3578 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 3946 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-05-22&endday=2023-05-28&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 3885 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-06-05&endday=2023-06-11&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 4079 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-06-12&endday=2023-06-18&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3880 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-06-19&endday=2023-06-25&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 3276 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-07-31&endday=2023-08-06&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 4018 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-10-02&endday=2023-10-08&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 3484 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-10-16&endday=2023-10-22&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 3356 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-10-30&endday=2023-11-05&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 3623 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-11-20&endday=2023-11-26&tree=all

Comment 44

[Intermittent Failures Robot]

2 failures in 4108 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-11-27&endday=2023-12-03&tree=all

Comment 45

[Intermittent Failures Robot]

2 failures in 4224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-12-11&endday=2023-12-17&tree=all

Comment 46

[Intermittent Failures Robot]

3 failures in 3349 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2023-12-18&endday=2023-12-24&tree=all

Comment 47

[Intermittent Failures Robot]

1 failures in 2274 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-01-01&endday=2024-01-07&tree=all

Comment 48

[Intermittent Failures Robot]

1 failures in 4034 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-01-22&endday=2024-01-28&tree=all

Comment 49

[Intermittent Failures Robot]

1 failures in 3952 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-01-29&endday=2024-02-04&tree=all

Comment 50

[Intermittent Failures Robot]

2 failures in 4009 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-02-05&endday=2024-02-11&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 3125 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-02-12&endday=2024-02-18&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 3382 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-02-19&endday=2024-02-25&tree=all

Comment 53

[Intermittent Failures Robot]

1 failures in 3791 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-03-18&endday=2024-03-24&tree=all

Comment 54

[Intermittent Failures Robot]

1 failures in 4252 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-04-15&endday=2024-04-21&tree=all

Comment 55

[Intermittent Failures Robot]

1 failures in 4059 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-04-29&endday=2024-05-05&tree=all

Comment 56

[Intermittent Failures Robot]

2 failures in 3995 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-05-20&endday=2024-05-26&tree=all

Comment 57

[Intermittent Failures Robot]

1 failures in 4202 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 58

[Intermittent Failures Robot]

1 failures in 4116 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-06-24&endday=2024-06-30&tree=all

Comment 59

[Intermittent Failures Robot]

1 failures in 3459 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-08-05&endday=2024-08-11&tree=all

Comment 60

[Intermittent Failures Robot]

1 failures in 3218 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-08-19&endday=2024-08-25&tree=all

Comment 61

[Intermittent Failures Robot]

1 failures in 4448 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-09-09&endday=2024-09-15&tree=all

Comment 62

[Intermittent Failures Robot]

2 failures in 4679 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-10-07&endday=2024-10-13&tree=all

Comment 63

[Intermittent Failures Robot]

1 failures in 4579 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-10-14&endday=2024-10-20&tree=all

Comment 64

[Valentin Gosu [:valentin]]

Attachment: Bug 1762911 - Remove InitializeStaticHeaders from expected leaks r=#necko

The leak was most likely related to HTTP/2 push.
I did a try push to check whether it still leaks - all green.
I think it's worth landing to confirm the leak is gone.

Comment 65

[Intermittent Failures Robot]

1 failures in 4361 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-10-28&endday=2024-11-03&tree=all

Comment 66

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/30d0ab34103f
Remove InitializeStaticHeaders from expected leaks r=necko-reviewers,webdriver-reviewers,kershaw

Comment 67

[agoloman]

https://hg.mozilla.org/mozilla-central/rev/30d0ab34103f

Comment 68

[Intermittent Failures Robot]

3 failures in 4515 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2
• mozilla-central: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 2
  • opt: 2
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-11-04&endday=2024-11-10&tree=all

Comment 69

[Valentin Gosu [:valentin]]

As far as I can tell there's no huge uptick in leaks.
I'll assume it's fixed. We can reopen if necessary.

Comment 70

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Yes, I did not see anything related for our wdspec tests which had a lot of those failures. Lets mark as fixed so that we have the version information available as well. Thanks!

Comment 72

[Intermittent Failures Robot]

1 failures in 4227 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr128: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-11-11&endday=2024-11-17&tree=all

Comment 73

[Intermittent Failures Robot]

1 failures in 3002 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• linux1804-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2024-11-18&endday=2024-11-24&tree=all

Comment 74

[Intermittent Failures Robot]

Summary

1 failures in 3682 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

Table

	no_variant
linux1804-64-shippable-qr/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-01-06&endday=2025-01-12&tree=all

Comment 75

[Intermittent Failures Robot]

Summary

1 failures in 4508 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-devedition-qr: 1
  • opt: 1

Table

	no_variant
linux1804-64-devedition-qr/-/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-01-13&endday=2025-01-19&tree=all

Comment 76

[Intermittent Failures Robot]

Summary

1 failures in 5022 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-32-qr: 1
  • opt: 1

Table

	no_variant
linux1804-32-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-02-10&endday=2025-02-16&tree=all

Comment 77

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Table

	no_variant
linux1804-64-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-04-07&endday=2025-04-13&tree=all

Comment 78

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Table

	no_variant
linux1804-32-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-04-28&endday=2025-05-04&tree=all

Comment 79

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
linux1804-x86_64/ccov	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-05-05&endday=2025-05-11&tree=all

Comment 80

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Table

	no_variant
linux1804-x86/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-06-16&endday=2025-06-22&tree=all

Comment 81

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr140: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-07-21&endday=2025-07-27&tree=all

Comment 82

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-08-11&endday=2025-08-17&tree=all

Comment 83

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-09-01&endday=2025-09-07&tree=all

Comment 84

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-09-29&endday=2025-10-05&tree=all

Comment 85

[Intermittent Failures Robot]

3 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Table

	no_variant
linux1804-x86_64/opt	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-10-06&endday=2025-10-12&tree=all

Comment 86

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-10-27&endday=2025-11-02&tree=all

Comment 87

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2025-12-08&endday=2025-12-14&tree=all

Comment 88

[Intermittent Failures Robot]

3 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Table

	no_variant
macosx1470-x86_64/opt	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2026-01-12&endday=2026-01-18&tree=all

Comment 89

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Table

	no_variant
macosx1470-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2026-01-19&endday=2026-01-25&tree=all

Comment 90

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 1

Table

	no_variant
linux1804-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1762911&startday=2026-02-09&endday=2026-02-15&tree=all