1390814 - Add disabled_addon_ids from 'payload->addonDetails' to the Main Summary

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement, P1)

Description

[Alessio Placitelli [:Dexter]]

Starting from Firefox 57, legacy addons will be deactivated and won't be reported anymore in the Environment->activeAddons section [1]. We need the information about installed (but inactive) legacy addons to suggest similar addons to the users using TAAR.

For this reason, we'd like to add the "Payload->addonDetails" [2] section to the main summary table. We're really just interested in the GUIDs for each addon, not the content of each addon block.

> "addonDetails": {
>   "XPI": {
>     "[e-mail]": {
>       ... data
>     },
>     "[e-mail]": {
>       ... data
>     },    ...
>   },
>   ...
> }

We just want ["[e-mail]", "[e-mail]"] to be in "addon_details" column.

[1] - https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/data/environment.html#activeaddons
[2] - https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/data/main-ping.html#addondetails

Comment 1

[mlopatka]

+1 on the above reasoning. The TAAR project team is aiming to deploy a shield study in mid September to evaluate the efficacy of personalized web extension recommendations based on a combined feature space derived from telelemtry information and installed addon information. 

It is essential that all information sources used in the shield study model are available in main_summary so that (if results are positive) that recommendation model can be updated as the addon ecosystem changes.

Comment 2

[Georg Fritzsche [:gfritzsche]]

We want to remove addonDetails in favor of the environment in the future.
To avoid having more dependencies on this field, lets try to add only the minimal data points you need to the datasets.
E.g. can you limit this to adding a field with, say, only the ids of inactive addons?

How long into the future do you expect to use this?

Comment 3

[Alessio Placitelli [:Dexter]]

(In reply to Georg Fritzsche [:gfritzsche] from comment #2)
> We want to remove addonDetails in favor of the environment in the future.
> To avoid having more dependencies on this field, lets try to add only the
> minimal data points you need to the datasets.
> E.g. can you limit this to adding a field with, say, only the ids of
> inactive addons?

Yes, this shouldn't be a problem.

> How long into the future do you expect to use this?

I would expect this to be used just for FF 57-58.

Comment 4

[Alessio Placitelli [:Dexter]]

Attachment: Main summary PR

This takes care of adding the list of inactive addon ids to the main summary, with a clear commit message/comment about the purpose and a note that it should not be used for stuff other than TAAR.

Comment 5

[Alessio Placitelli [:Dexter]]

Attachment: Docs PR

Comment 6

[Alessio Placitelli [:Dexter]]

The job is up and running and all the PR were merged. Documentation for the main summary was updated as well.