1882078 - [Rollout] The Viewpoint Survey heartbeat is displayed during the browser's first-run

Status: NEW

(Shield :: Shield Study, defect)

Description

[Patriciu Pop [:ppop], Ecosystem QA]

Attachment: heartbeat_on_first_run.gif

[Affected versions]:

• Firefox Release 123.0 (Build #20240213221259)

[Affected Platforms]:

• Windows 10 x64
• macOS 13.6.1
• Ubuntu 22.04 x64

[Prerequisites]:

• Have the latest Firefox Release 123. installed.
• Have a browser client enrolled in the Nimbus rollout that enables the Viewpoint Survey infobar.
  https://experimenter.services.mozilla.com/nimbus/legacy-nimbus-test-1-viewpoint/summary

[Steps to reproduce]:

1. Open the browser with the profile from prerequisites.
2. Observe the browser window.

[Expected result]:

• No infobars are generated on the first run.

[Actual result]:

• The Viewpoint survey infobar is displayed on the onborading screen.

[Notes]:

• According to the documentation the infobar should show on startup, not on first install, and not within 24 hours of first install.
• Tested using a new profile on an existing installation as well as a new one.
• The current Viewpoint Nimbus recipe does not contain any kind of filter or parameter that forces the user to wait 24h since the first install.
• Attached a screen recording of the issue:

Comment 1

[Punam Dahiya [:pdahiya]]

Attachment: survey-during-onboarding.jpeg

Current view point survey on desktop launched using legacyheartbeat Nimbus feature shows up on about:welcome distracting users while being onboarded. NI product to help weigh in severity of this fix Thanks!

Comment 2

[Alex Davis [:adavis]]

Punam, do we happen to have a screenshot? Are we able to avoid collisions between these messages using Nimbus?

Comment 3

[Punam Dahiya [:pdahiya]]

(In reply to Alex Davis [:adavis] from comment #2)

Punam, do we happen to have a screenshot? Are we able to avoid collisions between these messages using Nimbus?

Screenshot attached with comment #1, this can be avoided by using !isFirstStartup && profileRestartCount > 0 in Nimbus enrollment targeting so that viewpoint survey don't enroll users in their first run Thanks!

Comment 4

[nbulous]

Hey @pdahiya - when is the viewpoint survey supposed to be displayed? This seems like a P1. Also, do we have a time frame for when this has been happening? We should let UR know that it might impact results.

Comment 5

[Punam Dahiya [:pdahiya]]

(In reply to nbulous from comment #4)

Hey @pdahiya - when is the viewpoint survey supposed to be displayed? This seems like a P1. Also, do we have a time frame for when this has been happening? We should let UR know that it might impact results.

@nbulous viewpoint surveys are getting launched via Nimbus legacyHeartbeat feature, there is one live right now (May 9th onwards) that's enrolling 0.3% of population targeting all users Fx125+ for en locales