1938244 - Intermittent macosx1100 [tier 2] browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | single tracking bug

Status: RESOLVED FIXED

(Firefox :: Address Bar, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=487499321&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DXyIj2KEQh-9Fea1JLl-zA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-12-18T22:09:36.020Z] 22:09:36     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | 3 == 3 - 
[task 2024-12-18T22:09:36.020Z] 22:09:36     INFO - Test search engine for [object Object]
[task 2024-12-18T22:09:36.020Z] 22:09:36     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | true == true - 
[task 2024-12-18T22:09:36.020Z] 22:09:36     INFO - Buffered messages finished
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - TEST-UNEXPECTED-FAIL | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | Uncaught exception in test bound test_picked_search_engines - at chrome://mochitests/content/browser/browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js:104 - TypeError: can't access property "click", popup.querySelector(...) is null
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - Stack trace:
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - testSearchEngine@chrome://mochitests/content/browser/browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js:104:9
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - async*test_picked_search_engines@chrome://mochitests/content/browser/browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js:44:9
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1147:26
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1219:18
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - async*Tester_execTest@chrome://mochikit/content/browser-test.js:1360:14
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1136:14
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - Leaving test bound test_picked_search_engines
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - Entering test bound test_picked_settings
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | null == null - 
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | null == null - 
[task 2024-12-18T22:09:36.021Z] 22:09:36     INFO - Open a new tab
[task 2024-12-18T22:09:36.228Z] 22:09:36     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | true == true - 
[task 2024-12-18T22:10:20.747Z] 22:10:20     INFO - Not taking screenshot here: see the one that was previously logged
[task 2024-12-18T22:10:20.747Z] 22:10:20     INFO - TEST-UNEXPECTED-FAIL | browser/components/urlbar/tests/browser/browser_searchModeSwitcher_telemetry.js | Test timed out - 
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - GECKO(5191) | Completed ShutdownLeaks collections in process 5191
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - TEST-START | Shutdown
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - Browser Chrome Test Summary
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - Passed:  10671
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - Failed:  2
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - Todo:    0
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - Mode:    e10s
[task 2024-12-18T22:10:20.752Z] 22:10:20     INFO - *** End BrowserChrome Test Results ***
[task 2024-12-18T22:10:20.770Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.770Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.770Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.770Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - GECKO(5191) | Exiting due to channel error.
[task 2024-12-18T22:10:20.771Z] 22:10:20     INFO - TEST-INFO | Main app process: exit 0

Comment 1

[agoloman]

This started to fail with the changes from https://hg.mozilla.org/integration/autoland/rev/e8da1039fe2f4c237b5dc6702aaafe7bb21d30fc. It looks like it only fails on macosx1100-aarch64-shippable-qr: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2024-12-12&endday=2024-12-19&tree=trunk&bug=1938244.
Could you please take a look?

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1937074

Comment 3

[Moritz Beier [:mbeier]]

Looks like the test was added after my patch landed.

Comment 4

[Intermittent Failures Robot]

Summary

15 failures in 657 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 6
• mozilla-central: 8
• try: 1

Platform and build breakdown:

• macosx1100-aarch64-shippable-qr: 15
  • opt: 15

Table

	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	http3	msix	msix-s	no_variant	nofis	nofis-s	nofis-ship	nofis-ship-s	nofis-swr	s	spi-nw	spi-nw-nofis	spi-nw-s	swr	swr-s	vt	vt-s
macosx1100-aarch64-shippable-qr/opt													5			10

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-19&endday=2024-12-19&tree=all

Comment 5

[Intermittent Failures Robot]

Summary

15 failures in 557 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 3
• mozilla-central: 8
• autoland: 4

Platform and build breakdown:

• macosx1015-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 2
  • opt: 2
• macosx1100-aarch64-shippable-qr: 12
  • opt: 12

Table

	1proc	1proc-s	a11y-checks-swr	a11y-checks-swr-s	headless	http3	msix	no_variant	nofis	nofis-s	nofis-ship	nofis-swr	nogpu	s	spi-nw	spi-nw-1proc	spi-nw-nofis	spi-nw-s	swr	swr-s
macosx1015-64-devedition-qr/opt								1
macosx1015-64-shippable-qr/opt														2
macosx1100-aarch64-shippable-qr/opt														6				6

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-20&endday=2024-12-20&tree=all

Comment 6

[Intermittent Failures Robot]

Summary

55 failures in 3774 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #41 most frequent failure this week.

This failure happened more than 30 times this week! Resolving this bug is a high priority.

Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled.

Repository breakdown:

• try: 10
• autoland: 22
• mozilla-central: 23

Platform and build breakdown:

• macosx1015-64-devedition-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 2
  • opt: 2
• macosx1100-aarch64-shippable-qr: 48
  • opt: 48
• windows11-32-2009-qr: 1
  • debug: 1
• windows11-64-2009-devedition-qr: 1
  • opt: 1
• windows11-64-2009-shippable-qr: 1
  • opt: 1

Table

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	mda-gpu	mda-gpu-s	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nofis-swr-s	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-nofis	spi-nw-nofis-s	spi-nw-s	spi-s	swr	swr-s	vt	vt-s	wmfme	wr-dc1-p	wr-dc2-o	wr-dc3-c	wr-dc3-c-s	xorig	xorig-s
macosx1015-64-devedition-qr/opt																					2
macosx1015-64-shippable-qr/opt																																2
macosx1100-aarch64-shippable-qr/opt																																15						33
windows11-32-2009-qr/debug																					1
windows11-64-2009-devedition-qr/opt																					1
windows11-64-2009-shippable-qr/opt																																1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-16&endday=2024-12-22&tree=all

Comment 7

[Intermittent Failures Robot]

Summary

23 failures in 151 pushes (0.152 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 18
• mozilla-central: 3
• autoland: 2

Platform and build breakdown:

• macosx1015-64-devedition-qr: 2
  • opt: 2
• macosx1100-aarch64-shippable-qr: 7
  • opt: 7
• windows11-32-2009-qr: 1
  • debug: 1
• windows11-32-2009-shippable-qr: 2
  • opt: 2
• windows11-64-2009-devedition-qr: 2
  • opt: 2
• windows11-64-2009-qr: 6
  • debug: 6
• windows11-64-2009-shippable-qr: 3
  • opt: 3

Table

	a11y-checks	a11y-checks-s	http3	msix	msix-s	no_variant	nofis-s	nofis-ship-s	s	spi-nw	spi-nw-s	xorig	xorig-s
macosx1015-64-devedition-qr/opt						2
macosx1100-aarch64-shippable-qr/opt									4		3
windows11-32-2009-qr/debug						1
windows11-32-2009-shippable-qr/opt									2
windows11-64-2009-devedition-qr/opt						2
windows11-64-2009-qr/debug				3		3
windows11-64-2009-shippable-qr/opt					2				1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-24&endday=2024-12-24&tree=all

Comment 8

[Intermittent Failures Robot]

Summary

75 failures in 900 pushes (0.083 failures/push) were associated with this bug in the last 7 days.

This is the #11 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• try: 38
• autoland: 20
• mozilla-central: 17

Platform and build breakdown:

• macosx1015-64-devedition-qr: 3
  • opt: 3
• macosx1100-aarch64-shippable-qr: 41
  • opt: 41
• windows11-32-2009-qr: 2
  • debug: 2
• windows11-32-2009-shippable-qr: 6
  • opt: 6
• windows11-64-2009-devedition-qr: 4
  • opt: 4
• windows11-64-2009-qr: 10
  • debug: 10
• windows11-64-2009-shippable-qr: 9
  • opt: 9

Table

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-cf	spi-nw-nofis	spi-nw-s	swr	swr-s	vt	vt-s	wmfme	wmfme-s	xorig	xorig-s
macosx1015-64-devedition-qr/opt																			3
macosx1100-aarch64-shippable-qr/opt																													13						28
windows11-32-2009-qr/debug																			2
windows11-32-2009-shippable-qr/opt																													6
windows11-64-2009-devedition-qr/opt																			4
windows11-64-2009-qr/debug																	5		5
windows11-64-2009-shippable-qr/opt																		5											4

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-23&endday=2024-12-29&tree=all

Comment 9

[agoloman]

Attachment: Bug 1938244 - disable browser_searchModeSwitcher_telemetry.js for frequent failures on macosx1100. r=#intermittent-reviewers

Comment 10

[Mark Banner (:standard8)]

I've added this to the work tracking for scotch bonnet & increased the priority - since this is a new test and it is being disabled, I think we should look at fixing the issues as part of the work.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e39e35450405
disable browser_searchModeSwitcher_telemetry.js for frequent failures on macosx1100. r=urlbar-reviewers,Standard8 DONTBUILD

Comment 12

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/e39e35450405

Comment 13

[Intermittent Failures Robot]

Summary

45 failures in 1319 pushes (0.034 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

This failure happened more than 30 times this week! Resolving this bug is a high priority.

Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled.

Repository breakdown:

• try: 23
• mozilla-central: 9
• autoland: 13

Platform and build breakdown:

• macosx1015-64-devedition-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 3
  • opt: 3
• macosx1100-aarch64-shippable-qr: 25
  • opt: 25
• windows11-32-2009-qr: 2
  • debug: 2
• windows11-32-2009-shippable-qr: 3
  • opt: 3
• windows11-64-2009-devedition-qr: 2
  • opt: 2
• windows11-64-2009-qr: 2
  • debug: 2
• windows11-64-2009-shippable-qr: 6
  • opt: 6

Table

	msix	no_variant	spi-nw
macosx1015-64-devedition-qr/opt		2
macosx1015-64-shippable-qr/opt		3
macosx1100-aarch64-shippable-qr/opt		9	16
windows11-32-2009-qr/debug		2
windows11-32-2009-shippable-qr/opt		3
windows11-64-2009-devedition-qr/opt		2
windows11-64-2009-qr/debug	1	1
windows11-64-2009-shippable-qr/opt	3	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1938244&startday=2024-12-30&endday=2025-01-05&tree=all

Comment 14

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1936673

Comment 15

[Daisuke Akatsuka (:daisuke)]

Attachment: Bug 1938244: Re-enable browser_searchModeSwitcher_telemetry.js test for OSX

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5e5f724cb9a0
Re-enable browser_searchModeSwitcher_telemetry.js test for OSX r=daleharvey

Comment 17

[amarc]

https://hg.mozilla.org/mozilla-central/rev/5e5f724cb9a0

Comment 18

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:agoloman, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox135 to wontfix.

For more information, please visit BugBot documentation.

Comment 19

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-beta/rev/dc2a33374877