1868539 - Add a method of changing the remote settings server for SERP telemetry

Status: VERIFIED FIXED

(Fenix :: Search, task)

Description

[Mark Banner (:standard8)]

On desktop, Firefox has remote-setting-devtools which allows developers and QA to change the remote settings servers in use, so that changes to be published can be tested on staging or in preview, before they are release on production.

In bug 1834842 we are adding fetching the SERP telemetry parameters from remote settings. I feel that we should have a way to test any changes on staging or preview before we release this. Whilst we can test some of it via desktop, this is a new structure for mobile, and I'd be concerned that we could push an update that unexpectedly broke the mobile client in some manner if we don't have a way to test it.

The debug drawer planned in bug 1857080 would be a good way of adding this, but I think something needs to be implemented before this ships to release, so that we have the QA facilities available.

Comment 1

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1868539 - Add method of changing remote server url (#5323)

Comment 2

[BMO Github Automation]

Authored by https://github.com/sarah541
https://github.com/mozilla-mobile/firefox-android/commit/7d0c8cacb416c627eec2c1bb97b7d13964736130
[main] Bug 1868539 - Add method of changing remote server url

Comment 3

[Mira Lobontiu (Android QA)]

Hello, all!
Could you provide us some STR in order to verify this ticket?
Thank you!

Comment 4

[[:skhan]]

Hi yes, from the android side.

1. Go to Settings -> About Firefox
2. Click on Firefox logo 5 times to enable debug menu
3. Now go to Settings -> Secret Settings
4. The last setting (as of today) is "Use Remote Settings Production Server" is enabled by default

This mean we are using the main environment (production) to fetch collections from remote server i.e https://firefox.settings.services.mozilla.com
Disabling it would mean we are using it the test environment (staging) i.e https://firefox.settings.services.allizom.org

The changes take place only after restarting the app.

What this would mean in terms of SERP telemetry?
For the production server we are fetching our data from https://firefox.settings.services.mozilla.com/v1/buckets/main/collections/search-telemetry-v2/records
and for staging from https://firefox.settings.services.allizom.org/v1/buckets/main/collections/search-telemetry-v2/records

On sending telemetry, we are to make sure the correct (main or test) server's data is being fetched.

Comment 5

[Mira Lobontiu (Android QA)]

Attachment: Screenshot_20240213_183443_Firefox Nightly.jpg

Verified as fixed on today's Nightly 124.0a1 build, with a Samsung Galaxy A14 (Android 13) devices.
In Secret Settings, the "Use Remote Settings Production server" toggle is enabled by default.