1794715 - Intermittent browser/base/content/test/performance/browser_startup_mainthreadio.js | single tracking bug

Status: RESOLVED FIXED

(Firefox :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=392936575&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YVvLlowwTIuh-sxS7zDmFg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-10-11T23:19:03.082Z] 23:19:03     INFO - TEST-PASS | browser/base/content/test/performance/browser_startup_mainthreadio.js | close on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] as many times as expected before opening first browser window - 
[task 2022-10-11T23:19:03.084Z] 23:19:03     INFO - known main thread IO paths during before first paint:
[task 2022-10-11T23:19:03.084Z] 23:19:03     INFO -   /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] - condition: true, stat: 1, close: 1, listedPath: XREAppFeat:[e-mail]
[task 2022-10-11T23:19:03.085Z] 23:19:03     INFO -   *ld.so.conf* - condition: true, read: 22, close: 11, listedPath: *ld.so.conf*
[task 2022-10-11T23:19:03.085Z] 23:19:03     INFO -   /tmp/tmppxsycynp.mozrunner/d3d11layers.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:d3d11layers.guard
[task 2022-10-11T23:19:03.086Z] 23:19:03     INFO -   /tmp/tmppxsycynp.mozrunner/glcontext.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:glcontext.guard
[task 2022-10-11T23:19:03.087Z] 23:19:03     INFO -   /tmp/tmppxsycynp.mozrunner/wmfvpxvideo.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:wmfvpxvideo.guard
[task 2022-10-11T23:19:03.088Z] 23:19:03     INFO - Buffered messages finished
[task 2022-10-11T23:19:03.089Z] 23:19:03     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_mainthreadio.js | unexpected close on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] before first paint - 
[task 2022-10-11T23:19:03.089Z] 23:19:03     INFO - Stack trace:
[task 2022-10-11T23:19:03.089Z] 23:19:03     INFO -   0x7f294a6c7386
[task 2022-10-11T23:19:03.089Z] 23:19:03     INFO -   Task nsJARChannel::ContinueOpenLocalFile
[task 2022-10-11T23:19:03.089Z] 23:19:03     INFO -   XREMain::XRE_main
[task 2022-10-11T23:19:03.090Z] 23:19:03     INFO - (NSPRIOInterposer) close - /builds/worker/workspace/build/application/firefox/browser/features/[e-mail]
[task 2022-10-11T23:19:03.091Z] 23:19:03     INFO - (NSPRIOInterposer) stat - /builds/worker/workspace/build/application/firefox/browser/features/[e-mail]
[task 2022-10-11T23:19:03.092Z] 23:19:03     INFO - (NSPRIOInterposer) close - /builds/worker/workspace/build/application/firefox/browser/features/[e-mail]
[task 2022-10-11T23:19:03.093Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf
[task 2022-10-11T23:19:03.093Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.094Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.095Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.096Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/libc.conf
[task 2022-10-11T23:19:03.097Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/libc.conf
[task 2022-10-11T23:19:03.097Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/libc.conf
[task 2022-10-11T23:19:03.098Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/zz_x32-biarch-compat.conf
[task 2022-10-11T23:19:03.099Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/zz_x32-biarch-compat.conf
[task 2022-10-11T23:19:03.100Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/zz_x32-biarch-compat.conf
[task 2022-10-11T23:19:03.101Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/zz_i386-biarch-compat.conf
[task 2022-10-11T23:19:03.102Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/zz_i386-biarch-compat.conf
[task 2022-10-11T23:19:03.103Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/zz_i386-biarch-compat.conf
[task 2022-10-11T23:19:03.103Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/fakeroot-x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.104Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/fakeroot-x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.105Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/fakeroot-x86_64-linux-gnu.conf
[task 2022-10-11T23:19:03.106Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/i386-linux-gnu.conf
[task 2022-10-11T23:19:03.107Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf.d/i386-linux-gnu.conf
[task 2022-10-11T23:19:03.107Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf.d/i386-linux-gnu.conf
[task 2022-10-11T23:19:03.108Z] 23:19:03     INFO - (NSPRIOInterposer) read - /etc/ld.so.conf
[task 2022-10-11T23:19:03.109Z] 23:19:03     INFO - (NSPRIOInterposer) close - /etc/ld.so.conf
[task 2022-10-11T23:19:03.110Z] 23:19:03     INFO - TEST-PASS | browser/base/content/test/performance/browser_startup_mainthreadio.js | stat on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] as many times as expected before first paint -

Comment 1

[Natalia Csoregi [:nataliaCs]]

First occurrence so far with the new error: https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&selectedTaskRun=O2JdqLqzQo-nN0EaOXtS4A.0&searchStr=linux%2C18.04%2Cx64%2Cwebrender%2Copt%2Cmochitests%2Cwith%2Csoftware%2Cwebrender%2Cenabled%2Ctest-linux1804-64-qr%2Fopt-mochitest-browser-chrome-swr%2Cbc1&tochange=f36d9e78e41726fe8cd299e04b7fad07d208ec79&fromchange=77ad8aa7c1cf0ca257cf24c08368c3a9bd5759cc

TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_mainthreadio.js | unexpected close on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] before first paint -

Comment 2

[Intermittent Failures Robot]

15 failures in 3034 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 11
  • opt: 11
• linux1804-64-shippable-qr: 2
  • opt: 2
• windows10-64-2004-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 3

[Intermittent Failures Robot]

25 failures in 2793 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-qr: 12
  • opt: 12
• linux1804-64-shippable-qr: 10
  • opt: 10
• windows10-64-2004-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 4

[Intermittent Failures Robot]

28 failures in 3743 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 23
• try: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 7
  • opt: 7
• linux1804-64-qr: 18
  • opt: 18
• windows10-64-2004-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 5

[Intermittent Failures Robot]

41 failures in 3626 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 31
• mozilla-central: 10

Platform and build breakdown:

• linux1804-64-qr: 22
  • opt: 22
• linux1804-64-shippable-qr: 14
  • opt: 14
• windows10-64-2004-qr: 2
  • opt: 2
• windows10-64-2004-shippable-qr: 1
  • opt: 1
• windows10-64-2004-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 6

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 46 failures within the last 7 days:

• 25 failures on Linux 18.04 x64 WebRender opt
• 16 failures on Linux 18.04 x64 WebRender Shippable opt
• 2 failures on Windows 10 x64 2004 CCov WebRender opt
• 2 failures on Windows 10 x64 2004 WebRender opt
• 1 failure on Windows 10 x64 2004 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=395746742&repo=autoland&lineNumber=3832

[task 2022-11-07T10:39:50.214Z] 10:39:50     INFO - TEST-PASS | browser/base/content/test/performance/browser_startup_mainthreadio.js | close on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] as many times as expected before opening first browser window - 
[task 2022-11-07T10:39:50.215Z] 10:39:50     INFO - known main thread IO paths during before first paint:
[task 2022-11-07T10:39:50.215Z] 10:39:50     INFO -   /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] - condition: true, stat: 1, close: 1, listedPath: XREAppFeat:[e-mail]
[task 2022-11-07T10:39:50.216Z] 10:39:50     INFO -   *ld.so.conf* - condition: true, read: 22, close: 11, listedPath: *ld.so.conf*
[task 2022-11-07T10:39:50.216Z] 10:39:50     INFO -   /tmp/tmphpuxmi5b.mozrunner/d3d11layers.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:d3d11layers.guard
[task 2022-11-07T10:39:50.216Z] 10:39:50     INFO -   /tmp/tmphpuxmi5b.mozrunner/glcontext.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:glcontext.guard
[task 2022-11-07T10:39:50.217Z] 10:39:50     INFO -   /tmp/tmphpuxmi5b.mozrunner/wmfvpxvideo.guard - ignoreIfUnused: true, stat: 1, listedPath: ProfD:wmfvpxvideo.guard
[task 2022-11-07T10:39:50.217Z] 10:39:50     INFO - Buffered messages finished
[task 2022-11-07T10:39:50.218Z] 10:39:50     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_mainthreadio.js | unexpected close on /builds/worker/workspace/build/application/firefox/browser/features/[e-mail] before first paint - 
[task 2022-11-07T10:39:50.218Z] 10:39:50     INFO - Stack trace:
[task 2022-11-07T10:39:50.218Z] 10:39:50     INFO -   0x7f34f5fd75f6
[task 2022-11-07T10:39:50.218Z] 10:39:50     INFO -   Task nsJARChannel::ContinueOpenLocalFile
[task 2022-11-07T10:39:50.219Z] 10:39:50     INFO -   XREMain::XRE_main
[task 2022-11-07T10:39:50.219Z] 10:39:50     INFO - (NSPRIOInterposer) close - /builds/worker/workspace/build/application/firefox/browser/features/[e-mail]

Dave, can you help us assign this to someone?
Thank you.

Comment 7

[Intermittent Failures Robot]

37 failures in 3445 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #16 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 35
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-qr: 25
  • opt: 25
• linux1804-64-shippable-qr: 8
  • opt: 8
• windows10-64-2004-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-07&endday=2022-11-13&tree=all

Comment 8

[Marian-Vasile Laza]

There have been 35 total failures in the last 7 days, recent failure log.
Affected platforms are:

• linux1804-64-qr
• linux1804-64-shippable-qr
• windows10-64-2004-qr
• windows10-64-2004-shippable-qr
• windows7-32-qr

Comment 9

[Intermittent Failures Robot]

15 failures in 629 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 6
  • opt: 6
• linux1804-64-shippable-qr: 2
  • opt: 2
• windows7-32-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-16&endday=2022-11-16&tree=all

Comment 10

[Intermittent Failures Robot]

49 failures in 3589 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #25 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 7
• autoland: 40
• try: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 12
  • opt: 12
• windows7-32-qr: 8
  • opt: 8
• linux1804-64-qr: 28
  • opt: 28
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-14&endday=2022-11-20&tree=all

Comment 11

[Marian-Vasile Laza]

There have been 46 total failures in the last 7 days, recent failure log.
Affected platforms are:

• linux1804-64-qr
• linux1804-64-shippable-qr
• macosx1015-64-qr
• windows10-32-2004-qr
• windows10-64-2004-qr
• windows10-64-2004-shippable-qr
• windows7-32-qr

Comment 12

[Intermittent Failures Robot]

46 failures in 3888 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #23 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 37
• mozilla-central: 7
• try: 2

Platform and build breakdown:

• linux1804-64-qr: 25
  • opt: 25
• linux1804-64-shippable-qr: 6
  • opt: 6
• windows10-64-2004-qr: 4
  • opt: 4
• windows10-32-2004-qr: 2
  • opt: 2
• windows7-32-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • opt: 1
• windows10-64-2004-ccov-qr: 1
  • opt: 1
• windows7-32-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 13

[Intermittent Failures Robot]

20 failures in 746 pushes (0.027 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 16
• mozilla-central: 4

Platform and build breakdown:

• windows7-32-qr: 5
  • opt: 5
• linux1804-64-qr: 6
  • opt: 6
• linux1804-64-shippable-qr: 4
  • opt: 4
• windows10-64-2004-qr: 2
  • opt: 2
• windows7-32-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-29&endday=2022-11-29&tree=all

Comment 14

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1794715 - Disable browser_startup_mainthreadio.js on !debug (linux and win) for frequent failures. r=#intermittent-reviewers

Comment 15

[Florian Quèze [:florian]]

Attachment: Bug 1794715 - adjust the known main thread I/O list and disable browser_startup_mainthreadio.js on Windows 32 bits where NSS is sometimes initialized too early, r=jmaher.

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bd717140fb06
adjust the known main thread I/O list and disable browser_startup_mainthreadio.js on Windows 32 bits where NSS is sometimes initialized too early, r=jmaher.

Comment 17

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/bd717140fb06

Comment 18

[Intermittent Failures Robot]

55 failures in 3938 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #18 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 18
• autoland: 36
• try: 1

Platform and build breakdown:

• windows7-32-shippable-qr: 10
  • opt: 10
• linux1804-64-shippable-qr: 12
  • opt: 12
• windows10-64-2004-ccov-qr: 1
  • opt: 1
• windows7-32-qr: 13
  • opt: 13
• windows10-64-2004-qr: 5
  • opt: 5
• linux1804-64-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2022-11-28&endday=2022-12-04&tree=all

Comment 19

[Cosmin Sabou [:CosminS]]

No failures so far since Dec 2nd. https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2022-11-28&endday=2022-12-05&tree=trunk&bug=1794715

Comment 20

[Intermittent Failures Robot]

3 failures in 3657 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3

Platform and build breakdown:

• windows11-64-2009-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2023-10-23&endday=2023-10-29&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 3288 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2023-11-06&endday=2023-11-12&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 1162 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2023-12-25&endday=2023-12-31&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 4336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1794715&startday=2024-04-22&endday=2024-04-28&tree=all