2058339 - Intermittent browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | single tracking bug

Status: RESOLVED FIXED

(Toolkit :: Form Autofill, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=581210901&repo=autoland&task=CB8wfXNaQ3mVBEWmnucvtw.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CB8wfXNaQ3mVBEWmnucvtw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2026-07-27T22:58:37.341+00:00] 22:58:37     INFO - TEST-PASS | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | Should be an valid section - true == true
[task 2026-07-27T22:58:37.341+00:00] 22:58:37     INFO - Buffered messages finished
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | Expected 1 event of type detected_address_form. - 4 == 1
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:188
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.342+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.344+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.345+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | Expected 1 event of type detected_address_form_ext. - 4 == 1
[task 2026-07-27T22:58:37.345+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:195
[task 2026-07-27T22:58:37.345+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.346+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "false" == "0"
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.347+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.349+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.349+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.349+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.349+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.351+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "false" == "0"
[task 2026-07-27T22:58:37.351+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.351+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.352+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.353+00:00] 22:58:37     INFO - TEST-PASS | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "true"
[task 2026-07-27T22:58:37.353+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "0"
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.355+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.356+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.357+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "0"
[task 2026-07-27T22:58:37.357+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.357+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.358+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.359+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.359+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "0"
[task 2026-07-27T22:58:37.359+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.359+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.361+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged
[task 2026-07-27T22:58:37.362+00:00] 22:58:37     INFO - TEST-UNEXPECTED-FAIL | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "0"
[task 2026-07-27T22:58:37.362+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:assertTelemetry:206
[task 2026-07-27T22:58:37.362+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/browser_ml_heuristics.js:onTestComplete:83
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/runTest/<:1784
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - resource://testing-common/BrowserTestUtils.sys.mjs:withNewTab:132
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:runTest:1678
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochitests/content/browser/browser/extensions/formautofill/test/browser/head.js:add_heuristic_tests/</<:1809
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:handleTask:1402
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1492
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1644
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1382
[task 2026-07-27T22:58:37.364+00:00] 22:58:37     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1060
[task 2026-07-27T22:58:37.365+00:00] 22:58:37     INFO - TEST-PASS | browser/extensions/formautofill/test/browser/browser_ml_heuristics.js | "true" == "true"
[task 2026-07-27T22:58:37.365+00:00] 22:58:37     INFO - Not taking screenshot here: see the one that was previously logged

Comment 1

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 23

Table

	a11y-checks-swr	a11y_checks+swgl	msix	no-nv	no_variant	standalone	swgl	swr
linux2404-x86_64/opt	2			1				2
macosx1015-x86_64/opt					1
windows11-x86/opt					3
windows11-x86_64/opt			5	5	4

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2058339&startday=2026-07-28&endday=2026-07-28&tree=all

Comment 2

[Intermittent Failures Robot]

17 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 3
• try: 1

Table

	a11y-checks-swr	a11y_checks+swgl	msix	no-nv	no_variant	standalone	swgl
linux2404-x86_64/opt	1
macosx1015-x86_64/opt					2
windows11-x86/opt					4
windows11-x86_64/debug					1
windows11-x86_64/opt			5	2	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2058339&startday=2026-07-29&endday=2026-07-29&tree=all

Comment 3

[Intermittent Failures Robot]

26 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 2
• try: 1

Table

	a11y-checks-swr	a11y_checks+swgl	msix	no-nv	no_variant	standalone	swgl	swr
linux2404-x86_64/opt	3			1				2
macosx1015-x86_64/opt					1
windows11-x86/opt					6
windows11-x86_64/debug					1
windows11-x86_64/opt			4	4	4

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2058339&startday=2026-07-30&endday=2026-07-30&tree=all

Comment 4

[Florian Quèze [:florian]]

Attachment: Bug 2058339 - Don't let address form telemetry recorded by earlier tests leak into browser_ml_heuristics.js, r=#credential-management-reviewers.

assertTelemetry only reset FOG at the end of each task, so the first task read
whichever detected_address_form event was already in the store. In the
formautofill browser chunk, browser_label_matching.js detects an address form
21s earlier and nothing resets FOG in between, so events[0] was that test's
event and each extra key comparison failed.

Also fix the pref name in add_setup, which was spelled "useml.succeeded" and
made the pushPrefEnv call a no-op, and set the pref through pushPrefEnv in
onTestComplete so that it no longer leaks to the rest of the chunk.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/758c2881c1b3
https://hg.mozilla.org/integration/autoland/rev/133a9001b7e6
Don't let address form telemetry recorded by earlier tests leak into browser_ml_heuristics.js, r=credential-management-reviewers,NeilDeakin.

Comment 6

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/133a9001b7e6

Comment 7

[Intermittent Failures Robot]

83 failures were associated with this bug in the last 7 days.
This is the #43 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 75
• mozilla-central: 5
• try: 3

Table

	a11y-checks-swr	a11y_checks+swgl	cf	msix	no-nv	no_variant	standalone	swgl	swr
linux2404-x86_64/opt	7				4				4
macosx1015-x86_64/opt						5
macosx1500-aarch64/opt						1
windows11-x86/opt			1			19
windows11-x86_64/debug						2
windows11-x86_64/opt				15	13	12

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2058339&startday=2026-07-27&endday=2026-08-02&tree=all