Closed Bug 1492431 Opened 3 years ago Closed 3 years ago

The "CFR Recommendation", for the "Amazon" website, is wrongly displayed on "Experiment 1" and "Experiment 2" branches

Categories

(Firefox :: Messaging System, defect, P2)

Unspecified
All
defect

Tracking

()

VERIFIED FIXED
Firefox 64
Iteration:
64.2 - Sep 28
Tracking Status
firefox-esr60 --- unaffected
firefox62 --- unaffected
firefox63 --- verified
firefox64 --- verified

People

(Reporter: mcoman, Assigned: k88hudson)

References

(Blocks 1 open bug)

Details

(Keywords: regression)

Attachments

(1 file)

Attached image rec of the issue.gif
[Affected versions]:
- Firefox 63 and above

[Affected Platforms]:
- All Windows
- All Linux
- All Mac

[Prerequisites]:
- Have a Firefox profile with the following prefs in the "about:config" page:
	- "browser.newtabpage.activity-stream.asrouterExperimentEnabled" with "true" value;
	- "browser.newtabpage.activity-stream.asrouter.messageProviders" with "[{"id":"cfr", "cohort": "one_per_day", "frequency": {"custom": [{"period": "daily", "cap": 1}]}, "type":"local","localProvider":"CFRMessageProvider","enabled":true}]" value.
	- "browser.search.region" set to "US";
	- "devtools.chrome.enabled" set to true.
- Have the "Browser Console" opened.

[Steps to reproduce]:
1. Open the browser with the profile from prerequisites.
2. Open a new tab and navigate to "www.amazon.com".
3. Focus the "Browser Console" and enter the following string: "NewTabUtils.activityStreamProvider.getTopFrecentSites({numItems: 25}).then(r => console.log(r.map(s=>`${s.url} [${s.frecency}]`).join('\n')))".
4. Repeat step 2 until the Amazon "frecency" score, from the browser console, is at least 10000.
5. Restart the browser and navigate to "www.amazon.com" in a new tab again.
6. Observe the right part of the "Address Bar".

[Expected result]:
- Only the "Page actions", "Save to Pocket" and "Bookmark this page" buttons are displayed.

[Actual result]:
- The "CFR Recommendation" button is also displayed.

[Notes]:
- Attached a screen recording of the issue.
I do not see this as of September 22 nightly (this may have been fixed by https://bugzilla.mozilla.org/show_bug.cgi?id=1492174), can you verify if this is still an issue?
Marius, could you take another crack at reproducing this?
Iteration: --- → 64.2 (Sep 28)
Flags: needinfo?(marius.coman)
Priority: -- → P2
I have verified that this issue is no longer reproducible on Windows 10 x64, Arch Linux and Mac 10.13.3 with the latest "Firefox Nightly" (64.0a1 - Build ID 20180924100354) installed.

Also, using the "Mozregression" tool I have managed to find the regression window:

First good revision: fba337077a687723353e3b5bdae58a5f1996d516
Last bad revision: e7665879a630451639a42a2d75383b24928b90a2
Pushlog:
https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=e7665879a630451639a42a2d75383b24928b90a2&tochange=fba337077a687723353e3b5bdae58a5f1996d516+

From the pushlog it seems that this issue was fixed in Bug 1492174.

Considering the above I am closing this issue as Resolved Fixed.
Status: NEW → RESOLVED
Closed: 3 years ago
Flags: needinfo?(marius.coman)
Resolution: --- → FIXED
I have verified that this issue is no longer reproducible on Windows 10 x64, Arch Linux and Mac 10.13.3 with the latest "Firefox Beta" (63.0b9 - Build ID 20180924202103) installed. Now the "CFR Recommendation", for the "Amazon" website is no longer displayed on "Experiment 1" and "Experiment 2" branches.
Status: RESOLVED → VERIFIED
Blocks: 1493794
Assignee: nobody → khudson
Component: Activity Streams: Newtab → Messaging System
You need to log in before you can comment on or make changes to this bug.