1895741 - Intermittent valgrind-test | 28 bytes in 1 blocks are definitely lost at malloc / __res_context_send / __res_context_query / __res_context_querydomain

Status: RESOLVED FIXED

(Core :: Networking: DNS, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=457440901&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/UKBXjuwpQVW2aQbDZfON0w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-05-08T14:54:54.137Z] 14:54:54     INFO -  ==24842== Searching for pointers to 67,246 not-freed blocks
[task 2024-05-08T14:54:54.501Z] 14:54:54     INFO -  ==24842== Checked 198,375,728 bytes
[task 2024-05-08T14:54:54.501Z] 14:54:54     INFO -  ==24842==
[task 2024-05-08T14:54:55.969Z] 14:54:55     INFO -  TEST-UNEXPECTED-FAIL | valgrind-test | 28 bytes in 1 blocks are definitely lost at malloc / __res_context_send / __res_context_query / __res_context_querydomain
[task 2024-05-08T14:54:55.969Z] 14:54:55     INFO -  ==24842== 28 bytes in 1 blocks are definitely lost in loss record 6,309 of 22,589
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    at 0x48407B4: malloc+116 (vg_replace_malloc.c:393)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4CAA2D4: __res_context_send+980 (res_send.c:325)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4CA754B: __res_context_query+411 (res_query.c:221)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4CA8189: __res_context_querydomain (res_query.c:633)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4CA8189: __res_context_search+1033 (res_query.c:389)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4CA1718: _nss_dns_gethostbyname4_r+584 (dns-host.c:418)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4C6C635: get_nss_addresses (getaddrinfo.c:637)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4C6C635: gaih_inet (getaddrinfo.c:1170)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x4C6C635: getaddrinfo+7141 (getaddrinfo.c:2391)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0x59860D1: PR_GetAddrInfoByName+257 (checkouts/gecko/nsprpub/pr/src/misc/prnetdb.c:2164)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB263BCE: _GetAddrInfo_Portable (checkouts/gecko/netwerk/dns/GetAddrInfo.cpp:244)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB263BCE: mozilla::net::GetAddrInfo(nsTSubstring<char> const&, unsigned short, unsigned short, mozilla::net::AddrInfo**, bool)+478 (checkouts/gecko/netwerk/dns/GetAddrInfo.cpp:377)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB297D0F: nsHostResolver::ThreadFunc()+639 (checkouts/gecko/netwerk/dns/nsHostResolver.cpp:1891)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: operator()<> (dist/include/nsThreadUtils.h:1085)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: __invoke_impl<void, (lambda at /builds/worker/workspace/obj-build/dist/include/nsThreadUtils.h:1084:9)> (fetches/sysroot-x86_64-linux-gnu/usr/lib/gcc/x86_64-linux-gnu/8/../../../../include/c++/8/bits/invoke.h:60)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: __invoke<(lambda at /builds/worker/workspace/obj-build/dist/include/nsThreadUtils.h:1084:9)> (fetches/sysroot-x86_64-linux-gnu/usr/lib/gcc/x86_64-linux-gnu/8/../../../../include/c++/8/bits/invoke.h:95)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: __apply_impl<(lambda at /builds/worker/workspace/obj-build/dist/include/nsThreadUtils.h:1084:9), std::tuple<> &> (fetches/sysroot-x86_64-linux-gnu/usr/lib/gcc/x86_64-linux-gnu/8/../../../../include/c++/8/tuple:1678)
[task 2024-05-08T14:54:55.972Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: apply<(lambda at /builds/worker/workspace/obj-build/dist/include/nsThreadUtils.h:1084:9), std::tuple<> &> (fetches/sysroot-x86_64-linux-gnu/usr/lib/gcc/x86_64-linux-gnu/8/../../../../include/c++/8/tuple:1687)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: apply<nsHostResolver, void (nsHostResolver::*)()> (dist/include/nsThreadUtils.h:1083)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB2A6E16: mozilla::detail::RunnableMethodImpl<nsHostResolver*, void (nsHostResolver::*)(), true, (mozilla::RunnableKind)0>::Run()+38 (dist/include/nsThreadUtils.h:1134)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB0B8E78: nsThreadPool::Run()+904 (checkouts/gecko/xpcom/threads/nsThreadPool.cpp:341)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB0B39B6: nsThread::ProcessNextEvent(bool, bool*)+1542 (checkouts/gecko/xpcom/threads/nsThread.cpp:1193)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB0B75CB: NS_ProcessNextEvent(nsIThread*, bool)+75 (checkouts/gecko/xpcom/threads/nsThreadUtils.cpp:480)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB7AE4C6: mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*)+118 (checkouts/gecko/ipc/glue/MessagePump.cpp:300)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB75AEF4: RunInternal (checkouts/gecko/ipc/chromium/src/base/message_loop.cc:370)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB75AEF4: RunHandler (checkouts/gecko/ipc/chromium/src/base/message_loop.cc:363)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB75AEF4: MessageLoop::Run()+84 (checkouts/gecko/ipc/chromium/src/base/message_loop.cc:345)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0xB0B1183: nsThread::ThreadFunc(void*)+339 (checkouts/gecko/xpcom/threads/nsThread.cpp:370)
[task 2024-05-08T14:54:55.973Z] 14:54:55     INFO -  ==24842==    by 0x5995765: _pt_root+501 (checkouts/gecko/nsprpub/pr/src/pthreads/ptthread.c:201)
[task 2024-05-08T14:54:55.974Z] 14:54:55     INFO -  ==24842==    by 0x12FE53: set_alt_signal_stack_and_start(PthreadCreateParams*)+211 (checkouts/gecko/mozglue/interposers/pthread_create_interposer.cpp:81)
[task 2024-05-08T14:54:55.974Z] 14:54:55     INFO -  ==24842==    by 0x4C03FD3: start_thread+707 (pthread_create.c:442)
[task 2024-05-08T14:54:55.974Z] 14:54:55     INFO -  ==24842==    by 0x4C8381F: clone+63 (clone.S:100)
[task 2024-05-08T14:54:55.974Z] 14:54:55     INFO -  ==24842==

Comment 1

[Intermittent Failures Robot]

13 failures in 3649 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 4

Platform and build breakdown:

• linux64-qr: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-06&endday=2024-05-12&tree=all

Comment 2

[Intermittent Failures Robot]

27 failures in 4547 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-beta: 12
• mozilla-central: 4

Platform and build breakdown:

• linux64-qr: 27
  • opt: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-13&endday=2024-05-19&tree=all

Comment 3

[Intermittent Failures Robot]

24 failures in 901 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 17
• autoland: 7

Platform and build breakdown:

• linux64-qr: 24
  • opt: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-22&endday=2024-05-22&tree=all

Comment 4

[Intermittent Failures Robot]

17 failures in 722 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 4
• mozilla-beta: 13

Platform and build breakdown:

• linux64-qr: 17
  • opt: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-23&endday=2024-05-23&tree=all

Comment 5

[Intermittent Failures Robot]

75 failures in 3995 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-beta: 48
• autoland: 25
• mozilla-central: 2

Platform and build breakdown:

• linux64-qr: 75
  • opt: 75

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-20&endday=2024-05-26&tree=all

Comment 6

[Intermittent Failures Robot]

63 failures in 4202 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #18 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 25
• mozilla-central: 5
• mozilla-beta: 29
• try: 4

Platform and build breakdown:

• linux64-qr: 63
  • opt: 63

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 7

[Intermittent Failures Robot]

38 failures in 3649 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #35 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-release: 3
• autoland: 27
• try: 1
• mozilla-central: 6
• mozilla-beta: 1

Platform and build breakdown:

• linux64-qr: 38
  • opt: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-03&endday=2024-06-09&tree=all

Comment 8

[Intermittent Failures Robot]

20 failures in 801 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-beta: 9
• mozilla-central: 3

Platform and build breakdown:

• linux64-qr: 19
  • opt: 19
• windows11-32-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-11&endday=2024-06-11&tree=all

Comment 9

[Intermittent Failures Robot]

26 failures in 841 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 23
• autoland: 1
• mozilla-central: 2

Platform and build breakdown:

• linux64-qr: 26
  • opt: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-13&endday=2024-06-13&tree=all

Comment 10

[Intermittent Failures Robot]

15 failures in 869 pushes (0.017 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 9
• autoland: 6

Platform and build breakdown:

• linux64-qr: 15
  • opt: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-14&endday=2024-06-14&tree=all

Comment 11

[Intermittent Failures Robot]

102 failures in 4625 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 31
• mozilla-central: 11
• mozilla-beta: 60

Platform and build breakdown:

• linux64-qr: 101
  • opt: 101
• windows11-32-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-10&endday=2024-06-16&tree=all

Comment 12

[Ryan VanderMeulen [:RyanVM]]

This is basically permafailing. Can we please get someone from the Necko team to take a look?

Comment 13

[Ryan VanderMeulen [:RyanVM]]

Started immediately around when bug 1890999 landed.

Comment 14

[BugBot [:suhaib / :marco]]

Set release status flags based on info from the regressing bug 1890999

Comment 15

[Intermittent Failures Robot]

25 failures in 812 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 14
• mozilla-release: 7
• autoland: 3
• mozilla-esr128: 1

Platform and build breakdown:

• linux64-qr: 25
  • opt: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-17&endday=2024-06-17&tree=all

Comment 16

[Intermittent Failures Robot]

85 failures in 939 pushes (0.091 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 63
• mozilla-central: 5
• autoland: 13
• mozilla-release: 4

Platform and build breakdown:

• linux64-qr: 85
  • opt: 85

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-18&endday=2024-06-18&tree=all

Comment 17

[Kershaw Chang [:kershaw]]

I'll take this.

Comment 18

[Intermittent Failures Robot]

23 failures in 883 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 7
• mozilla-central: 5
• autoland: 11

Platform and build breakdown:

• linux64-qr: 23
  • opt: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-19&endday=2024-06-19&tree=all

Comment 19

[Intermittent Failures Robot]

33 failures in 923 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 3
• mozilla-beta: 13

Platform and build breakdown:

• linux64-qr: 33
  • opt: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-20&endday=2024-06-20&tree=all

Comment 20

[Kershaw Chang [:kershaw]]

See this try push.
Looks like the leak is caused by calling res_ninit. When I removed that code and call res_close when the DNS thread shutdown, the test passed.

Comment 21

[Kershaw Chang [:kershaw]]

Attachment: Bug 1895741 - Clear _res when DNS thread is shutdown, r=#necko

Comment 22

[Intermittent Failures Robot]

21 failures in 822 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 14
• mozilla-central: 1
• autoland: 6

Platform and build breakdown:

• linux64-qr: 21
  • opt: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-21&endday=2024-06-21&tree=all

Comment 23

[Intermittent Failures Robot]

233 failures in 4577 pushes (0.051 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-beta: 152
• mozilla-central: 14
• autoland: 55
• mozilla-release: 11
• mozilla-esr128: 1

Platform and build breakdown:

• linux64-qr: 233
  • opt: 233

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 24

[Intermittent Failures Robot]

25 failures in 890 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-release: 6
• mozilla-beta: 10

Platform and build breakdown:

• linux64-qr: 25
  • opt: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-24&endday=2024-06-24&tree=all

Comment 25

[Intermittent Failures Robot]

19 failures in 817 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-beta: 9
• mozilla-central: 1

Platform and build breakdown:

• linux64-qr: 19
  • opt: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-25&endday=2024-06-25&tree=all

Comment 26

[Intermittent Failures Robot]

24 failures in 654 pushes (0.037 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 5
• mozilla-beta: 18
• try: 1

Platform and build breakdown:

• linux64-qr: 24
  • opt: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-26&endday=2024-06-26&tree=all

Comment 27

[Intermittent Failures Robot]

19 failures in 818 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 12
• autoland: 4
• mozilla-central: 3

Platform and build breakdown:

• linux64-qr: 19
  • opt: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-27&endday=2024-06-27&tree=all

Comment 28

[Intermittent Failures Robot]

114 failures in 4116 pushes (0.028 failures/push) were associated with this bug in the last 7 days.

This is the #11 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 38
• mozilla-beta: 59
• mozilla-release: 6
• try: 1
• mozilla-central: 10

Platform and build breakdown:

• linux64-qr: 114
  • opt: 114

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-06-24&endday=2024-06-30&tree=all

Comment 29

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f99352890323
Clear _res when DNS thread is shutdown, r=sunil

Comment 30

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/f99352890323

Comment 31

[BugBot [:suhaib / :marco]]

The patch landed in nightly and beta is affected.
:kershaw, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox128 to wontfix.

For more information, please visit BugBot documentation.

Comment 32

[Intermittent Failures Robot]

27 failures in 3199 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• autoland: 13
• mozilla-central: 4
• mozilla-release: 5
• mozilla-esr128: 3

Platform and build breakdown:

• linux64-qr: 27
  • opt: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-07-01&endday=2024-07-07&tree=all

Comment 33

[Intermittent Failures Robot]

4 failures in 3780 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• linux64-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-07-08&endday=2024-07-14&tree=all

Comment 34

[Ryan VanderMeulen [:RyanVM]]

Please nominate this for ESR128 approval.

Comment 35

[Kershaw Chang [:kershaw]]

Attachment: Bug 1895741 - Clear _res when DNS thread is shutdown,

Comment 36

[Phabricator Automation]

esr128 Uplift Approval Request

• User impact if declined: Memory leak
• Code covered by automated testing: yes
• Fix verified in Nightly: yes
• Needs manual QE test: no
• Steps to reproduce for manual QE testing: N/A
• Risk associated with taking this patch: Low risk.
• Explanation of risk level: This patch is straightforward.
• String changes made/needed: N/A
• Is Android affected?: no

Comment 37

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-esr128/rev/5136dd39b5bc

Comment 38

[Intermittent Failures Robot]

22 failures in 3799 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 12
• mozilla-esr128: 10

Platform and build breakdown:

• linux64-qr: 22
  • opt: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-07-15&endday=2024-07-21&tree=all

Comment 39

[Intermittent Failures Robot]

3 failures in 4124 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform and build breakdown:

• linux64-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895741&startday=2024-07-22&endday=2024-07-28&tree=all