1692153 - Intermittent test-coverage browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the opensearch.html page exposes 3 engines - Got +0, expected 3

Status: RESOLVED FIXED

(Firefox :: Search, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: cbrindusan [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=329591973&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dYvAKawaSgSW_UneBbjw9w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-02-11T07:03:49.064Z] 07:03:49     INFO - TEST-START | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js
[task 2021-02-11T07:03:50.916Z] 07:03:50     INFO - TEST-INFO | started process screenshot
[task 2021-02-11T07:03:50.987Z] 07:03:50     INFO - TEST-INFO | screenshot: exit 0
[task 2021-02-11T07:03:50.988Z] 07:03:50     INFO - <snipped 23 output lines - if you need more context, please use SimpleTest.requestCompleteLog() in your test>
[task 2021-02-11T07:03:50.989Z] 07:03:50     INFO - Buffered messages logged at 07:03:49
[task 2021-02-11T07:03:50.989Z] 07:03:50     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no one-off button should be selected - 
[task 2021-02-11T07:03:50.990Z] 07:03:50     INFO - now test the up arrow key[task 2021-02-11T07:03:51.026Z] 07:03:51     INFO - Leaving test bound test_alt_up
[task 2021-02-11T07:03:51.026Z] 07:03:51     INFO - Entering test bound test_tab_and_arrows
[task 2021-02-11T07:03:51.026Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no one-off button should be selected - 
[task 2021-02-11T07:03:51.026Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no suggestion should be selected - 
[task 2021-02-11T07:03:51.027Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the textfield value should be unmodified - 
[task 2021-02-11T07:03:51.027Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the first one-off button should be selected - 
[task 2021-02-11T07:03:51.027Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no suggestion should be selected - 
[task 2021-02-11T07:03:51.027Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the second one-off button should be selected - 
[task 2021-02-11T07:03:51.027Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no suggestion should be selected - 
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the first one-off button should be selected - 
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | no suggestion should be selected - 
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - Leaving test bound test_tab_and_arrows
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - Entering test bound test_open_search
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - Opening search panel
[task 2021-02-11T07:03:51.028Z] 07:03:51     INFO - TEST-PASS | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | Should show the small popup - 
[task 2021-02-11T07:03:51.029Z] 07:03:51     INFO - Buffered messages finished
[task 2021-02-11T07:03:51.029Z] 07:03:51     INFO - TEST-UNEXPECTED-FAIL | browser/components/search/test/browser/browser_searchbar_smallpanel_keyboard_navigation.js | the opensearch.html page exposes 3 engines - Got +0, expected 3```

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Failures only on the slow code coverage platforms so far.

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Sorry, seems this test never ran in that configuration (test-coverage).

Comment 3

[Intermittent Failures Robot]

2 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-ccov: 1
  • opt: 1
• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1692153&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 4

[Mark Banner (:standard8)]

I've just taken a look and there's a couple of issues here:

• First, when run on its own the test seems to permanently fail for me. I think this is down to how the popup is being referenced when checking for the "Add search engine" buttons.
• Second, there's some cross process communication happening between the page that loads the links and the UI. If that did get delayed a reasonable amount, then you'd hit a failure. I'm not sure it would definitely happen in test machines, but whilst we're here we'll prevent the possibility.

Comment 5

[Mark Banner (:standard8)]

Attachment: Bug 1692153 - Improve browser_searchbar_smallpanel_keyboard_navigation.js so that it runs standalone and avoids possible intermittent failures. r?mak!

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b470b6c2d14f
Improve browser_searchbar_smallpanel_keyboard_navigation.js so that it runs standalone and avoids possible intermittent failures. r=mak

Comment 7

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/b470b6c2d14f