Closed Bug 1281536 Opened 4 years ago Closed 4 years ago

Un-expire or remove reader mode histogram probes

Categories

(Toolkit :: Reader Mode, defect, P1)

defect

Tracking

()

RESOLVED FIXED
mozilla50
Tracking Status
firefox50 --- fixed

People

(Reporter: Margaret, Assigned: Gijs)

Details

Attachments

(1 file)

The follow probes are expiring in Firefox 50:

* READER_MODE_DOWNLOAD_MS expires in version 50.0a1 (watched by mleibovic@mozilla.com) - Time (ms) to download a document to show in reader mode
* READER_MODE_DOWNLOAD_RESULT expires in version 50.0a1 (watched by mleibovic@mozilla.com) - The result of trying to download a document to show in reader view (0=Success, 1=Error XHR, 2=Error no document)
* READER_MODE_PARSE_RESULT expires in version 50.0a1 (watched by mleibovic@mozilla.com) - The result of trying to parse a document to show in reader view (0=Success, 1=Error too many elements, 2=Error in worker, 3=Error no article)
* READER_MODE_SERIALIZE_DOM_MS expires in version 50.0a1 (watched by mleibovic@mozilla.com) - Time (ms) to serialize a DOM to send to the reader worker
* READER_MODE_WORKER_PARSE_MS expires in version 50.0a1 (watched by mleibovic@mozilla.com) - Time (ms) for the reader worker to parse a document

In an email thread, Gijs proposed removing all of them except READER_MODE_PARSE_RESULT. That sounds fine to me.
I don't have a strong opinion here, but I'd suggest keeping both READER_MODE_PARSE_RESULT and READER_MODE_DOWNLOAD_RESULT as general quality/problem indicators. The time probes seem fine to let expire.
(In reply to Justin Dolske [:Dolske] from comment #1)
> I don't have a strong opinion here, but I'd suggest keeping both
> READER_MODE_PARSE_RESULT and READER_MODE_DOWNLOAD_RESULT as general
> quality/problem indicators. The time probes seem fine to let expire.

+1
Assignee: nobody → gijskruitbosch+bugs
Status: NEW → ASSIGNED
Attachment #8764973 - Flags: review?(margaret.leibovic) → review+
Comment on attachment 8764973 [details]
Bug 1281536 - remove reader mode telemetry that's out of date, extend two existing probes,

https://reviewboard.mozilla.org/r/60544/#review57680

::: toolkit/components/telemetry/Histograms.json:9596
(Diff revision 1)
> -    "n_buckets": 60,
> -    "description": "Time (ms) to download a document to show in reader mode"
> -  },
>    "READER_MODE_PARSE_RESULT" : {
> -    "expires_in_version": "50",
> +    "expires_in_version": "54",
>      "alert_emails": ["mleibovic@mozilla.com"],

I think we should update these emails to alert firefox-dev instead of my personal email account :)
Attachment #8764973 - Flags: review?(rweiss) → review?(benjamin)
Attachment #8764973 - Flags: review?(benjamin) → review+
Comment on attachment 8764973 [details]
Bug 1281536 - remove reader mode telemetry that's out of date, extend two existing probes,

https://reviewboard.mozilla.org/r/60544/#review59428

::: toolkit/components/telemetry/Histograms.json:9602
(Diff revision 1)
>      "kind": "enumerated",
>      "n_values": 5,
>      "description": "The result of trying to parse a document to show in reader view (0=Success, 1=Error too many elements, 2=Error in worker, 3=Error no article)"
>    },
>    "READER_MODE_DOWNLOAD_RESULT" : {
> -    "expires_in_version": "50",
> +    "expires_in_version": "54",

Responding to the bug comment: there should be somebody in particular who is responsible for these probes, not just a mailng list. It's fine to also add the list to the email alerts.

Be aware, that the alerting mechanism only works properly for scalar values, so you should not expect alerts for changes here: if this is in fact valuable data, somebody should either be responsible for monitoring it on a regular (weekly?) basis, or developing a real alerting mechanism.
Pushed by gijskruitbosch@gmail.com:
https://hg.mozilla.org/integration/fx-team/rev/ec92630e4c63
remove reader mode telemetry that's out of date, extend two existing probes, r=margaret,data-r=bsmedberg
(In reply to Benjamin Smedberg  [:bsmedberg] from comment #5)
> Comment on attachment 8764973 [details]
> Bug 1281536 - remove reader mode telemetry that's out of date, extend two
> existing probes,
> 
> https://reviewboard.mozilla.org/r/60544/#review59428
> 
> ::: toolkit/components/telemetry/Histograms.json:9602
> (Diff revision 1)
> >      "kind": "enumerated",
> >      "n_values": 5,
> >      "description": "The result of trying to parse a document to show in reader view (0=Success, 1=Error too many elements, 2=Error in worker, 3=Error no article)"
> >    },
> >    "READER_MODE_DOWNLOAD_RESULT" : {
> > -    "expires_in_version": "50",
> > +    "expires_in_version": "54",
> 
> Responding to the bug comment: there should be somebody in particular who is
> responsible for these probes, not just a mailng list. It's fine to also add
> the list to the email alerts.

Swapped to gijs@ + firefox-dev.

> Be aware, that the alerting mechanism only works properly for scalar values,
> so you should not expect alerts for changes here: if this is in fact
> valuable data, somebody should either be responsible for monitoring it on a
> regular (weekly?) basis, or developing a real alerting mechanism.

Is there a bug tracking making this work in general? Seems like generally, changes in distribution should trigger alerts, not just for scalars. If there is no prospect of that happening I can look at doing something myself or finding a PM who can own looking at this every week, but it'd be nice if we can delegate this to machines in general...
Flags: needinfo?(benjamin)
Better alerting is on the longer-term roadmap for the data engineering team, but it's probably going to be at least three months; there's a bunch of core scheduling and validation work that needs to happen first to support a general solution.
Flags: needinfo?(benjamin)
Priority: -- → P1
https://hg.mozilla.org/mozilla-central/rev/ec92630e4c63
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla50
You need to log in before you can comment on or make changes to this bug.