Open Bug 1873335 Opened 1 year ago Updated 4 months ago

Intermittent [tier 2] browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js | single tracking bug

Categories

(Firefox :: Search, defect, P5)

defect

Tracking

()

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

References

Details

(Keywords: intermittent-failure, intermittent-testcase)

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=442401658&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aR5DC9dhSc-25HIQ2fRJIg/runs/0/artifacts/public/logs/live_backing.log


[task 2024-01-06T11:49:52.976Z] 11:49:52     INFO - TEST-PASS | browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js | unexpected counts should be zero for FX_SEARCHBAR_SELECTED_RESULT_METHOD index 3 - false == false - 
[task 2024-01-06T11:49:52.976Z] 11:49:52     INFO - Leaving test bound test_oneOff_click
[task 2024-01-06T11:49:52.977Z] 11:49:52     INFO - Entering test bound test_suggestion_click
[task 2024-01-06T11:49:52.977Z] 11:49:52     INFO - Perform a one-off search using the first engine.
[task 2024-01-06T11:49:52.978Z] 11:49:52     INFO - Clicking the searchbar suggestion.
[task 2024-01-06T11:49:52.978Z] 11:49:52     INFO - Buffered messages finished
[task 2024-01-06T11:49:52.979Z] 11:49:52     INFO - TEST-UNEXPECTED-FAIL | browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js | Node is not accessible via accessibility API: id: , tagName: richlistitem, className: autocomplete-richlistitem - 
[task 2024-01-06T11:49:52.980Z] 11:49:52     INFO - Stack trace:
[task 2024-01-06T11:49:52.980Z] 11:49:52     INFO - chrome://mochikit/content/browser-test.js:test_ok:1591
[task 2024-01-06T11:49:52.981Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:a11yFail:508
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:assertCanBeClicked:846
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:runIfA11YChecks/this.AccessibilityUtils:822
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/AccessibilityUtils.js:handleEvent:939
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouseAtPoint:758
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouse:565
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/EventUtils.js:synthesizeMouseAtCenter:846
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js:clickSearchbarSuggestion:46
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js:checkSuggestionClick:329
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochitests/content/browser/browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js:test_suggestion_click:383
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/browser-test.js:handleTask:1138
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1210
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1352
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1127
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1058
[task 2024-01-06T11:49:52.982Z] 11:49:52     INFO - TEST-PASS | browser/components/search/test/browser/telemetry/browser_search_telemetry_searchbar.js | browser.engagement.navigation.searchbar must be recorded. - true == true - 

This may be also resolved by the patch for bug 1876421 or with a similar approach.

Depends on: 1876421

Adding richlistbox and richlistitem specifically to the patch D200744 - the issue here is that the entire autocomplete menu is removed from the tree as soon as it is clicked, thus the accessible (that the a11y_checks are checking after this click) is often dead by the time of the check runs. The extended test case in the patch proposed should be able to account for the early accessible removal case too.

Depends on: 1878395

This will be skipped by the work in this patch; is there someone who could take a look at the changes necessary to make a11y-checks happy here so we can continue to run this on tier 2?
:ayeddi do you know who this should be flagged to? your comment above looks like it lays out the issue

Flags: needinfo?(ayeddi)
You need to log in before you can comment on or make changes to this bug.