1275153 - Analyze UI telemetry from synced tabs menu panel and sidebar

Status: RESOLVED FIXED

(Firefox :: Sync, defect, P2)

Description

[Mark Hammond [:markh] [:mhammond]]

+++ This bug was initially created as a clone of Bug #1241571 +++

The "user story" and attachment in bug 1241571 describes the artifacts we wish to measure from the Synced Tabs UI. That bug landed the telemetry measurements while this bug is to analyze that telemetry to produce the requested artifacts.

Ilana, are you still able to help us with this, and if so, is there anything you need from us to help get started? Note that only Nightly builds from the last few days will be reporting this data, but that might be enough to get started, even if it isn't enough to produce valid data yet.

Thanks!

Comment 1

[Ilana]

Mark,
What's the time frame you need this analysis for? I'm happy to do some work, but I'm about a week or two out from finishing my highest priority projects.

Comment 2

[Mark Hammond [:markh] [:mhammond]]

(In reply to Ilana from comment #1)
> Mark,
> What's the time frame you need this analysis for? I'm happy to do some work,
> but I'm about a week or two out from finishing my highest priority projects.

A few weeks would be absolutely perfect (and as mentioned, I don't think you will have reasonable data until at least then anyway)

Thanks! I hope you don't mind, but I assigned this to you to help it avoid falling off the radar.

Comment 3

[Ilana]

We currently are in the process of migrating UITelemetry to a format that will easily allow us to pull data into re:dash and do analysis/vizzes by sql query. As far as I understand, this project is anticipated to be finished by the end of the quarter.
Is this soon enough for analysis? If not, we should set up time to chat so that I can see what questions need to be answered/help set you up with an analysis script.

Comment 4

[Mark Hammond [:markh] [:mhammond]]

(In reply to Ilana from comment #3)
> We currently are in the process of migrating UITelemetry to a format that
> will easily allow us to pull data into re:dash and do analysis/vizzes by sql
> query. As far as I understand, this project is anticipated to be finished by
> the end of the quarter.
> Is this soon enough for analysis? If not, we should set up time to chat so
> that I can see what questions need to be answered/help set you up with an
> analysis script.

Thanks Ilana. The questions we want answered can be seen in https://bugzilla.mozilla.org/attachment.cgi?id=8741110 (and more generally in bug 1241571). Re priorities, I'm not completely sure - I know that rfeeley is keen to get some of these answers so we can deliver improvements this quarter - and I'm concerned that waiting for an improved UITelemetry framework will push out beyond this quarter and risk us not being able to see this data until the end of the year.

Chris and Ryan, what are your thoughts in the priority here?

Comment 5

[Mark Hammond [:markh] [:mhammond]]

Ilana has kindly offered to put together a skeleton script and walk me through it, which will hopefully give us a first cut. We'll probably wait for the new-world-order before making a persistent dashboard.

Comment 6

[Lina Butler [:lina]]

From Alex during triage: the metrics we have point to challenges around discoverability. Once people discover synced tabs, they use them; the difficulty is finding them.