1849148 - The wrong message is displayed on the Fakespot Sidebar when analyzing the reviews for a product

Status: RESOLVED WORKSFORME

(Firefox :: Shopping, defect, P3)

Description

[Rares Doghi, Desktop QA]

Attachment: WrongWarning.mp4

Found in

• Nightly 118.0a1 (2023-08-17)

Affected versions

• Nightly 118.0a1 (2023-08-17)

Affected platforms

• ALL

Preconditions:
Set the browser.shopping.experience2023.enabled - TRUE
Set the browser.shopping.experience2023.optedIn - 1
Set the toolkit.shopping.useOHTTP - TRUE

Steps to reproduce

1. Reach the Amazon.com website and search for nintendo switch lite.
2. Select any product in order to reach the product details page.
3. Click the Analyze reviews link from the Fakespot sidebar.
4. Click back on the tab with the product details.

Expected result

• The Analysis is coming soon message is displayed in the Fakespot sidebar.

Actual result

• The Not enough reviews error is displayed inside the Fakespot Sidebar.

Please note that after the product was analyzed by Fakespot and the user returned to the product details page the Ratings and Highlights from recent reviews were displayed without issues.
Please also note that this issue has a low reproducible rate.

Regression range
Not Applicable

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:rdoghi, if you think that's a regression, could you try to find a regression range using for example mozregression?

Comment 2

[:Gijs (he/him)]

Could we get the network request/response details from the browser toolbox after turning off OHTTP for a case where this reproduces?

Comment 3

[Rares Doghi, Desktop QA]

Since we are hitting production instead of staging now and pretty much all products have already been analyzed I dont think we can find this specific scenario again.
We need to find a product whos never been analyzed that returns the Not enough reviews message while its being analyzed by Fakespot. Maybe we can even close the issue and reopen in case it ever happens again?

Comment 4

[:Gijs (he/him)]

(In reply to Rares Doghi, Desktop QA from comment #3)

Since we are hitting production instead of staging now and pretty much all products have already been analyzed I dont think we can find this specific scenario again.
We need to find a product whos never been analyzed that returns the Not enough reviews message while its being analyzed by Fakespot. Maybe we can even close the issue and reopen in case it ever happens again?

I think you just need niche products for this. I looked for some model railway stuff (there, that tells you something about me!) and e.g. this has never been analyzed and has no reviews. I expect this is the case for most results for e.g. "esu loksound" which is how I found the other item, or "roco z21" (e.g. this). If you don't know what to search for in model railway land, I bet other small-interest hobbies like fishing or slot racing or something like this will have similar results. Does that help at all?

Comment 5

[Rares Doghi, Desktop QA]

Attachment: HAR_FILE.7z

Comment 6

[Rares Doghi, Desktop QA]

I was able to reproduce it again and I saved a Har file from the Network tab, I will attach it to this bug please let me know if its not the right information you were looking for.

Comment 7

[Fred Chasen [:fchasen]]

This was fixed by removing the caching in https://phabricator.services.mozilla.com/D188309
and checking the current analysis status in https://bugzilla.mozilla.org/show_bug.cgi?id=1851629.

Comment 8

[Rares Doghi, Desktop QA]

Closing this as Works for me in our latest Nightly build: 20230920005018 since Bug 1851629 landed.
We are now seeing the correct "Checking review quality This could take about 60 seconds." message after which it changes to the Not enough reviews.