Open Bug 1885478 Opened 1 year ago Updated 4 months ago

Intermittent TV browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js | single tracking bug

Categories

(Firefox :: Search, defect, P5)

Product:
Firefox
Component:
Search
Type:
defect

Tracking

()

Tracking Flags:
Tracking Status
firefox-esr115 --- unaffected
firefox123 --- unaffected
firefox124 --- unaffected
firefox125 --- affected
firefox126 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail)

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=450834501&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LFFVuLQFQ2WlOvrhq979VA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LFFVuLQFQ2WlOvrhq979VA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2024-03-15T01:41:57.281Z] 01:41:57     INFO - TEST-PASS | browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js | Should have the correct number of categorization impressions. - 0 == 0 - 
[task 2024-03-15T01:41:57.281Z] 01:41:57     INFO - Leaving test bound test_no_reporting_if_no_records
[task 2024-03-15T01:41:57.281Z] 01:41:57     INFO - Entering test bound test_reporting_limited_to_10_domains_of_each_kind
[task 2024-03-15T01:41:57.282Z] 01:41:57     INFO - Buffered messages logged at 01:41:55
[task 2024-03-15T01:41:57.282Z] 01:41:57     INFO - Load a sample SERP with more than 10 organic results and more than 10 sponsored results.
[task 2024-03-15T01:41:57.283Z] 01:41:57     INFO - Buffered messages finished
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - TEST-UNEXPECTED-FAIL | browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js | Should have the correct number of categorization impressions. - 1 == 0 - {"filename":"chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/head.js","name":"assertCategorizationValues","sourceId":666,"lineNumber":441,"columnNumber":10,"sourceLine":"","asyncCause":null,"asyncCaller":null,"caller":{"filename":"chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js","name":"test_reporting_limited_to_10_domains_of_each_kind","sourceId":668,"lineNumber":202,"columnNumber":29,"sourceLine":"","asyncCause":null,"asyncCaller":{"filename":"chrome://mochikit/content/browser-test.js","name":"handleTask","sourceId":570,"lineNumber":1139,"columnNumber":26,"sourceLine":"","asyncCause":null,"asyncCaller":null,"caller":{"filename":"chrome://mochikit/content/browser-test.js","name":"_runTaskBasedTest","sourceId":570,"lineNumber":1211,"columnNumber":18,"sourceLine":"","asyncCause":null,"asyncCaller":{"filename":"chrome://mochikit/content/browser-test.js","name":"Tester_execTest","sourceId":570,"lineNumber":1353,"columnNumber":14,"sourceLine":"","asyncCause":null,"asyncCaller":null,"caller":{"filename":"chrome://mochikit/content/browser-test.js","name":"nextTest/<","sourceId":570,"lineNumber":1122,"columnNumber":14,"sourceLine":"","asyncCause":null,"asyncCaller":null,"caller":{"filename":"chrome://mochikit/content/tests/SimpleTest/SimpleTest.js","name":"SimpleTest.waitForFocus/<","sourceId":598,"lineNumber":1058,"columnNumber":13,"sourceLine":"","asyncCause":null,"asyncCaller":null,"caller":null,"formattedStack":"SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"formattedStack":"nextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"formattedStack":"async*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14\nnextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"caller":null,"formattedStack":"_runTaskBasedTest@chrome://mochikit/content/browser-test.js:1211:18\nasync*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14\nnextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"formattedStack":"async*handleTask@chrome://mochikit/content/browser-test.js:1139:26\n_runTaskBasedTest@chrome://mochikit/content/browser-test.js:1211:18\nasync*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14\nnextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"caller":null,"formattedStack":"test_reporting_limited_to_10_domains_of_each_kind@chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js:202:29\nasync*handleTask@chrome://mochikit/content/browser-test.js:1139:26\n_runTaskBasedTest@chrome://mochikit/content/browser-test.js:1211:18\nasync*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14\nnextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}},"formattedStack":"assertCategorizationValues@chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/head.js:441:10\ntest_reporting_limited_to_10_domains_of_each_kind@chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js:202:29\nasync*handleTask@chrome://mochikit/content/browser-test.js:1139:26\n_runTaskBasedTest@chrome://mochikit/content/browser-test.js:1211:18\nasync*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14\nnextTest/<@chrome://mochikit/content/browser-test.js:1122:14\nSimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13\n","nativeSavedFrame":{}}
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - Stack trace:
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/head.js:assertCategorizationValues:441
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js:test_reporting_limited_to_10_domains_of_each_kind:202
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochikit/content/browser-test.js:handleTask:1139
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1211
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1353
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1122
[task 2024-03-15T01:41:57.287Z] 01:41:57     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1058
[task 2024-03-15T01:41:57.288Z] 01:41:57     INFO - Checking categorization at index: 0
[task 2024-03-15T01:41:57.288Z] 01:41:57     INFO - Not taking screenshot here: see the one that was previously logged
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - TEST-UNEXPECTED-FAIL | browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js | Uncaught exception in test bound test_reporting_limited_to_10_domains_of_each_kind - at chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/head.js:475 - TypeError: can't access property "organic_category", actual is undefined
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - Stack trace:
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - assertCategorizationValues@chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/head.js:475:11
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - test_reporting_limited_to_10_domains_of_each_kind@chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js:202:29
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1139:26
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1211:18
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - async*Tester_execTest@chrome://mochikit/content/browser-test.js:1353:14
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1122:14
[task 2024-03-15T01:41:57.289Z] 01:41:57     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1058:13
[task 2024-03-15T01:41:57.290Z] 01:41:57     INFO - Leaving test bound test_reporting_limited_to_10_domains_of_each_kind
[task 2024-03-15T01:41:57.581Z] 01:41:57     INFO - GECKO(3951) | console.debug: SearchTelemetry: "Updated domain-to-categories map."
[task 2024-03-15T01:41:57.708Z] 01:41:57     INFO - GECKO(3951) | console.debug: SearchTelemetry: "Un-initializing domain-to-categories map."
[task 2024-03-15T01:41:57.709Z] 01:41:57     INFO - GECKO(3951) | console.debug: SearchTelemetry: "Removing Remote Settings client."
[task 2024-03-15T01:41:57.709Z] 01:41:57     INFO - GECKO(3951) | console.debug: SearchTelemetry: "Clearing domain-to-categories map."
[task 2024-03-15T01:41:57.709Z] 01:41:57     INFO - GECKO(3951) | console.debug: SearchTelemetry: "Un-initializing categorization event scheduler."
[task 2024-03-15T01:41:57.767Z] 01:41:57     INFO - GECKO(3951) | MEMORY STAT | vsize 7945MB | residentFast 315MB | heapAllocated 144MB
[task 2024-03-15T01:41:57.767Z] 01:41:57     INFO - TEST-OK | browser/components/search/test/browser/telemetry/browser_search_telemetry_domain_categorization_reporting.js | took 10001ms

:canova, since you are the author of the regressor, bug 1808648, could you take a look?

For more information, please visit BugBot documentation.

Flags: needinfo?(canaltinova)

My patch in bug 1808648 disabled a profiler test on tsan builds. This failure looks like on a different test on a different codebase, and it's not a tsan failure. I don't think this is a regression from bug 1808648.

:sstanca, could you take a look if another bug might be the regressor of this?

Flags: needinfo?(canaltinova) → needinfo?(sstanca)

Set release status flags based on info from the regressing bug 1808648

status-firefox123: --- → unaffected
status-firefox124: --- → unaffected
status-firefox125: --- → affected
status-firefox-esr115: --- → unaffected

Hi Nazim! This is a TV failure and it appears when some changes have been made to a certain file. Don't worry tho, this is not an action item ( also being tier 2).

Flags: needinfo?(sstanca)

(In reply to Serban Stanca [:SerbanS] from comment #4)

Hi Nazim! This is a TV failure and it appears when some changes have been made to a certain file. Don't worry tho, this is not an action item ( also being tier 2).

Going through the parsed log to the treeherder revision indicates that bug 1846367 was the one that triggered this though? Is the regressing bug here a typo or copy/paste error?

Flags: needinfo?(sstanca)

Oh my... Yes, you are right. I, somehow, copy pasted the wrong bug. Thank you for noticing that and also sorry for the misunderstood.

Flags: needinfo?(sstanca)
Regressed by: 1846367
No longer regressed by: 1808648

Set release status flags based on info from the regressing bug 1846367

status-firefox126: --- → affected
See Also: → 1890032
You need to log in before you can comment on or make changes to this bug.