1441551 - Provide public dataset for CA usage in Firefox release

Status: NEW

(Data Platform and Tools :: General, enhancement, P3)

Description

[J.C. Jones [:jcj] (he/they)]

Like PAGELOAD_IS_SSL, it is very useful for the ecosystem to monitor CERT_VALIDATION_SUCCESS_BY_CA for release populations. See websites like https://crt.sh/mozilla-certvalidations for examples.

This bug is to do the same general process as Bug 1414839. I think it would be fascinating to get the longitudinal analysis here too, if feasible.

Comment 1

[Ryan Harter [:harter]]

Chutten - can you appraise the feasibility of this request?

Comment 2

[Chris H-C :chutten]

Feasible, yes. We could use the same approach from bug 1414839.

However, it takes a while. It might make more sense to wait for the TMO 2018 plan and see if we'll be reintroducing release metrics sooner than we'd be able to custom-design a single-probe dataset.

:jcj, how urgent is this request?

Comment 3

[J.C. Jones [:jcj] (he/they)]

(In reply to Chris H-C :chutten from comment #2)
> Feasible, yes. We could use the same approach from bug 1414839.
> 
> However, it takes a while. It might make more sense to wait for the TMO 2018
> plan and see if we'll be reintroducing release metrics sooner than we'd be
> able to custom-design a single-probe dataset.
> 
> :jcj, how urgent is this request?

It's not urgent to me, though there are some folks in the community asking me about it since https://crt.sh/mozilla-certvalidations is busted.

If we want to put it on a backburner, I'll let the crt.sh folks know that they should stop reading Release telemetry and switch to Beta.

Comment 4

[Chris H-C :chutten]

Please do, I don't think we'll be able to get to this in this quarter.

Comment 5

[J.C. Jones [:jcj] (he/they)]

Hey Chris,

Just wanted to ping on this request to publish release numbers for CERT_VALIDATION_SUCCESS_BY_CA someplace. Maybe it's easier now, two years later? If not, maybe we should WONTFIX this.

Comment 6

[Chris H-C :chutten]

The TMO 2018 plan ended up including release data on the telemetry.mozilla.org Measurement Dashboard for anyone who has Mozilla auth. If this limited release isn't broad enough, then I'm afraid we need to WONTFIX this for now.

Though... Hamilton, are you interested in test cases for your new dataset publication process? This would be a nice choice for the first attempt: narrow focus, limited visibility, low risk, still very useful.