Closed Bug 1479744 Opened Last year Closed 10 months ago

Perma-fail [Test-Verfy] browser/base/content/test/about/browser_aboutHome_search_composing.js | waitForDocLoadAndStopIt: The expected URL was loaded - Got http://mochi.test:8888/?terms=xfoo, expected http://mochi.test:8888/?terms=xbar

Categories

(Firefox :: New Tab Page, defect, P1)

defect

Tracking

()

RESOLVED FIXED
Firefox 66
Iteration:
66.3 - Jan 7 - 20
Tracking Status
firefox65 --- wontfix
firefox66 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: andreio)

References

Details

(Keywords: intermittent-failure)

Attachments

(2 files)

Filed by: nbeleuzu [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=191082205&repo=autoland

https://queue.taskcluster.net/v1/task/Yb05ZDcVTAmUSFkVyJ8DuQ/runs/0/artifacts/public/logs/live_backing.log

11:41:14     INFO - Entering test bound 
11:41:14     INFO - Clicking suggestion list while composing
11:41:14     INFO - Console message: [JavaScript Warning: "Use of nsIFile in content process is deprecated." {file: "resource://gre/modules/FileUtils.jsm" line: 170}]
11:41:14     INFO - Waiting for engine to be added: searchSuggestionEngine.xml
11:41:14     INFO - Search engine added: searchSuggestionEngine.xml
11:41:14     INFO - Console message: Security Error: Content at about:newtab may not load or link to chrome://mozapps/skin/places/defaultFavicon.svg.
11:41:14     INFO - Console message: Security Error: Content at about:newtab may not load or link to chrome://mozapps/skin/places/defaultFavicon.svg.
11:41:14     INFO - Console message: Security Error: Content at about:home may not load or link to chrome://mozapps/skin/places/defaultFavicon.svg.
11:41:14     INFO - Console message: Security Error: Content at about:home may not load or link to chrome://mozapps/skin/places/defaultFavicon.svg.
11:41:14     INFO - Setting up the mutation observer before synthesizing composition
11:41:14     INFO - Waiting for search suggestion table unhidden
11:41:14     INFO - TEST-PASS | browser/base/content/test/about/browser_aboutHome_search_composing.js | Search suggestion table unhidden - true == true - 
11:41:14     INFO - waitForDocLoadAndStopIt: Waiting for URL: http://mochi.test:8888/?terms=xbar
11:41:14     INFO - Buffered messages finished
11:41:14     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/about/browser_aboutHome_search_composing.js | waitForDocLoadAndStopIt: The expected URL was loaded - Got http://mochi.test:8888/?terms=xfoo, expected http://mochi.test:8888/?terms=xbar
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: Last year
Resolution: --- → INCOMPLETE
Duplicate of this bug: 1506814
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Summary: Intermittent [Test-Verfy] browser/base/content/test/about/browser_aboutHome_search_composing.js | waitForDocLoadAndStopIt: The expected URL was loaded - Got http://mochi.test:8888/?terms=xfoo, expected http://mochi.test:8888/?terms=xbar → Perma-fail [Test-Verfy] browser/base/content/test/about/browser_aboutHome_search_composing.js | waitForDocLoadAndStopIt: The expected URL was loaded - Got http://mochi.test:8888/?terms=xfoo, expected http://mochi.test:8888/?terms=xbar
Note: Still happens as per bug 1506814. Looks like an activity stream related test, that perma fails during test-verify.
Component: General → Activity Streams: Newtab
Priority: P5 → --
Assignee: nobody → andrei.br92
Iteration: --- → 65.3 (Nov 30)
Priority: -- → P1
Attached image grafik.png
Did some investigation and I think I know why this is happening: TV does multiple test runs sometimes without restarting the browser. The first time this runs it types "X" in the search bar and "xfoo" "xbar" show up as suggestions. Second time around the first suggestion will be "X" from the previous query/history so the index of the expected result is now at position + 1.

I could look into fixing this but I'm not sure the search component is part of AS (we haven't really worked on it) ni? Standard8 for a second opinion.
Flags: needinfo?(standard8)
Well the test was written by Ed, and its within the new tab, which is why I pushed it in this direction... though as you say it is search related as well...

Given what you've said, I think the test just needs to clean up after itself - i.e. remove the saved suggestions. I'm not sure if that's PlacesUtils.history.clear() or something else. Maybe Drew knows?
Flags: needinfo?(standard8) → needinfo?(adw)
Yeah, it does look like all you need is `await PlacesUtils.history.clear()`.  I would call clear() both before and after the the main part of the test, to make sure the test starts with a blank slate, and then to clean up after itself as Mark says.  I'm guessing if you pause the test the second time it runs, you'll see that the first result has a little clock icon, indicating that it came from history.
Flags: needinfo?(adw)
It seems like `history.clear()` does not remove local search history, I couldn't find anything explicit about this except [0]
There seem to be some ways to explicitly remove them [1] and [2] but I couldn't get it to remove the result so I am probably not using the correct API. Do you know more about this?

[0] https://searchfox.org/mozilla-central/rev/3fdc51e66c9487b39220ad58dcee275fca070ccd/toolkit/components/search/SearchSuggestionController.jsm#72
[1] https://searchfox.org/mozilla-central/rev/3fdc51e66c9487b39220ad58dcee275fca070ccd/browser/modules/ContentSearch.jsm#208
[2] https://searchfox.org/mozilla-central/rev/3fdc51e66c9487b39220ad58dcee275fca070ccd/browser/modules/test/browser/browser_ContentSearch.js#218
Flags: needinfo?(adw)
You're right, this is form history, not browsing history, sorry.  It looks like you can remove all form history by calling FormHistory.update (in FormHistory.jsm) like this: https://dxr.mozilla.org/mozilla-central/rev/c2593a3058afdfeaac5c990e18794ee8257afe99/browser/base/content/test/sanitize/browser_sanitize-formhistory.js#9

It's implemented here, in case it helps: https://dxr.mozilla.org/mozilla-central/rev/c2593a3058afdfeaac5c990e18794ee8257afe99/toolkit/components/satchel/FormHistory.jsm#954
Flags: needinfo?(adw)
Iteration: 65.3 (Nov 30) → 66.2 - Dec 24 - Jan 6
Iteration: 66.2 - Dec 24 - Jan 6 → 66.3 - Jan 7 - 20
Pushed by aoprea@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/da8b6bcd0deb
Clear search history to prevent TV perma fail for browser/base/content/test/about/browser_aboutHome_search_composing.js r=adw
Status: REOPENED → RESOLVED
Closed: Last year10 months ago
Resolution: --- → FIXED
Target Milestone: --- → Firefox 66
Component: Activity Streams: Newtab → New Tab Page
You need to log in before you can comment on or make changes to this bug.