1723854 - Intermittent browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | leaked 2 window(s) until shutdown [url = about:preferences?definitionsUrl=http%3A%2F%2Flocalhost%3A49371%2Fdefinitions.json#paneExperimental]

Status: RESOLVED INCOMPLETE

(Firefox :: Settings UI, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=347286375&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LjEAcu5EREaGUnmFs1DEAQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-08-03T20:49:51.213Z] 20:49:51     INFO - TEST-INFO | Main app process: exit 0
[task 2021-08-03T20:49:51.214Z] 20:49:51     INFO - TEST-INFO | Confirming we saw 941 DOCSHELL created and 941 destroyed log strings.
[task 2021-08-03T20:49:51.214Z] 20:49:51     INFO - TEST-INFO | Confirming we saw 2289 DOMWINDOW created and 2289 destroyed log strings.
[task 2021-08-03T20:49:51.215Z] 20:49:51    ERROR - TEST-UNEXPECTED-FAIL | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | leaked 2 window(s) until shutdown [url = about:preferences?definitionsUrl=http%3A%2F%2Flocalhost%3A49371%2Fdefinitions.json#paneExperimental]
[task 2021-08-03T20:49:51.215Z] 20:49:51     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | windows(s) leaked: [pid = 1391] [serial = 754], [pid = 1391] [serial = 752]
[task 2021-08-03T20:49:51.215Z] 20:49:51     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | This test created 0 hidden window(s)
[task 2021-08-03T20:49:51.216Z] 20:49:51     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | This test created 1 hidden docshell(s)

Comment 1

[Intermittent Failures Robot]

16 failures in 2829 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 3

Platform and build breakdown:

• macosx1015-64-qr: 11
  • debug: 11
• linux1804-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 2

[Intermittent Failures Robot]

26 failures in 3025 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• autoland: 19
• mozilla-central: 4

Platform and build breakdown:

• macosx1015-64-qr: 21
  • debug: 21
• linux1804-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 3

[Intermittent Failures Robot]

20 failures in 2899 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 18
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 17
  • debug: 17
• linux1804-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 4

[Iulian Moraru]

Update:
There have been 29 failures within the last 7 days:
• 7 failures on Linux 18.04 x64 WebRender debug
• 22 failures on OS X 10.15 WebRender debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=349884394&repo=autoland&lineNumber=17458

Jared, as the owner of this component, could you help us assign it to someone?
Thank you.

Comment 5

[Intermittent Failures Robot]

29 failures in 2580 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 23
• mozilla-central: 6

Platform and build breakdown:

• macosx1015-64-qr: 22
  • debug: 22
• linux1804-64-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 6

[Intermittent Failures Robot]

27 failures in 3084 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 21
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 23
  • debug: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 7

[Intermittent Failures Robot]

7 failures in 3266 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 5
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-09-06&endday=2021-09-12&tree=all

Comment 8

[Intermittent Failures Robot]

15 failures in 3375 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 3
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• macosx1015-64-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 9

[:Gijs (back August 25; he/him)]

Gonna clear P5 so this shows up in triage.

This feels like a continuation of bug 1649173 that's come about via test reordering or something - but this time some of the failures are happening on Linux, e.g. https://treeherder.mozilla.org/jobs?repo=autoland&revision=e7459f43c36760e79f5435219d55458dab3b477b&selectedTaskRun=Ajf3gqjdSGmGD0frZXffjQ.0

Emilio, is getting this caught in RR/pernosco a realistic option based on that?

Comment 10

[Emilio Cobos Álvarez [:emilio]]

Maybe? I triggered it from https://pernos.co/self-service-api/mozilla/Ajf3gqjdSGmGD0frZXffjQ/self-service.html to see if pernosco manages to repro it.

Comment 11

[Intermittent Failures Robot]

26 failures in 2873 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• try: 2
• mozilla-central: 8

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• macosx1015-64-qr: 21
  • debug: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-09-20&endday=2021-09-26&tree=all

Comment 12

[Jared Wein [:jaws] (please needinfo? me)]

(In reply to Emilio Cobos Álvarez (:emilio) from comment #10)

Maybe? I triggered it from https://pernos.co/self-service-api/mozilla/Ajf3gqjdSGmGD0frZXffjQ/self-service.html to see if pernosco manages to repro it.

I looked at that Pernosco page and didn't see any results. I retriggered it from there again but also don't see any changes on the page. I'm not familar with the Pernosco self-serve API. Should we look somewhere else for results?

Comment 13

[Emilio Cobos Álvarez [:emilio]]

Yeah, I got an email like this:

Pernosco was not able to reproduce your test failure. (e7459f43c36760e79f5435219d55458dab3b477b)

Sorry, we tried our best but we were unable to reproduce a failure in your recent failed test-linux1804-64-qr/debug-mochitest-browser-chrome-swr-e10s-15 test job at https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=e7459f43c36760e79f5435219d55458dab3b477b.

You can view the test harness output at https://s3.us-east-2.amazonaws.com/pernosco-reproducer-logs/reproducer-mozilla-mozilla/R4RZqHcUQzaXPToWKgS1Ug/Ajf3gqjdSGmGD0frZXffjQ/requested-by-github/emilio-9a9e18593c380031-3fba8955.log.gz

So pernosco didn't manage to catch it :/

Comment 14

[Intermittent Failures Robot]

29 failures in 3376 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

Repository breakdown:

• autoland: 25
• try: 2
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 21
  • debug: 21
• linux1804-64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 15

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 37 failures within the last 7 days:

• 13 failures on Linux 18.04 x64 WebRender debug
• 24 failures on OS X 10.15 WebRender debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=354299853&repo=autoland&lineNumber=40502

[task 2021-10-10T21:07:09.490Z] 21:07:09     INFO - TEST-INFO | Main app process: exit 0
[task 2021-10-10T21:07:09.491Z] 21:07:09     INFO - TEST-INFO | Confirming we saw 1011 DOCSHELL created and 1011 destroyed log strings.
[task 2021-10-10T21:07:09.491Z] 21:07:09     INFO - TEST-INFO | Confirming we saw 2913 DOMWINDOW created and 2913 destroyed log strings.
[task 2021-10-10T21:07:09.492Z] 21:07:09    ERROR - TEST-UNEXPECTED-FAIL | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | leaked 2 window(s) until shutdown [url = about:preferences?definitionsUrl=http%3A%2F%2Flocalhost%3A50147%2Fdefinitions.json#paneExperimental]
[task 2021-10-10T21:07:09.492Z] 21:07:09     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | windows(s) leaked: [pid = 1998] [serial = 977], [pid = 1998] [serial = 979]
[task 2021-10-10T21:07:09.493Z] 21:07:09     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | This test created 0 hidden window(s)
[task 2021-10-10T21:07:09.493Z] 21:07:09     INFO - TEST-INFO | browser/components/preferences/tests/browser_experimental_features_hidden_when_not_public.js | This test created 1 hidden docshell(s)
[task 2021-10-10T21:07:09.493Z] 21:07:09     INFO - TEST-INFO | browser/components/preferences/tests/browser_advanced_update.js | This test created 0 hidden window(s)

Comment 16

[Intermittent Failures Robot]

36 failures in 3626 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #33 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 29
• mozilla-central: 7

Platform and build breakdown:

• macosx1015-64-qr: 23
  • debug: 23
• linux1804-64-qr: 13
  • debug: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 17

[Intermittent Failures Robot]

28 failures in 3315 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #50 most frequent failure this week.

Repository breakdown:

• autoland: 20
• mozilla-central: 8

Platform and build breakdown:

• macosx1015-64-qr: 15
  • debug: 15
• linux1804-64-qr: 13
  • debug: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-10-11&endday=2021-10-17&tree=all

Comment 18

[Intermittent Failures Robot]

25 failures in 3186 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

Repository breakdown:

• autoland: 16
• mozilla-central: 8
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 16
  • debug: 16
• linux1804-64-qr: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 19

[Intermittent Failures Robot]

24 failures in 2845 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

Repository breakdown:

• autoland: 18
• try: 2
• mozilla-central: 4

Platform and build breakdown:

• macosx1015-64-qr: 18
  • debug: 18
• linux1804-64-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-10-25&endday=2021-10-31&tree=all

Comment 20

[Intermittent Failures Robot]

32 failures in 3030 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-central: 12

Platform and build breakdown:

• macosx1015-64-qr: 19
  • debug: 19
• linux1804-64-qr: 13
  • debug: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-11-01&endday=2021-11-07&tree=all

Comment 21

[Sandor Molnar[:smolnar]]

Update:

There have been a total of 31 failures in the past 7 days on the following platforms:

• linux1804-64-qr debug
• macosx1015-64-qr debug

Recent failure log

Comment 22

[Intermittent Failures Robot]

31 failures in 2723 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #23 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 6
• autoland: 24
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 24
  • debug: 24
• linux1804-64-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-11-08&endday=2021-11-14&tree=all

Comment 23

[Andreea Pavel [:apavel]]

Attachment: Bug 1723854 - disable browser_experimental_features_hidden_when_not_public.js r?#intermittent-reviewers

Comment 24

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7aa5ff52f7ce
disable browser_experimental_features_hidden_when_not_public.js r?#intermittent-reviewers

Comment 25

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/7aa5ff52f7ce

Comment 26

[Intermittent Failures Robot]

33 failures in 3259 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #23 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 21
• mozilla-central: 12

Platform and build breakdown:

• linux1804-64-qr: 15
  • debug: 15
• macosx1015-64-qr: 18
  • debug: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723854&startday=2021-11-15&endday=2021-11-21&tree=all

Comment 27

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.