965475 - measure l10n completion daily

Status: RESOLVED FIXED

(Input Graveyard :: Frontend, defect, P1)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

We need to make sure we have translations for any strings changes we make before we can push those changes to production.

As such, we need a way to measure whether progress for translating.

Verbatim lets you see percent completed across all strings, but we don't actually care about all strings--just strings in specific parts of the codebase.

This bug is for implementing something that lets us see percent translated broken down by locale for the strings we're interested in over time.

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

This is important to do asap since it blocks future feedback form changes.

Making this a P1 for this quarter.

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

I think this requires the following:

1. a script that computes the percentages

2. a script that runs via cron at some specified time of day that does an svn up and runs the script from 1 and outputs JSON

3. a dashboard template that pulls the JSON and displays it in some way that lets me know when things are good

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

Items 1 and 2 are in a PR: https://github.com/mozilla/fjord/pull/205

After that lands, I'll work on a dashboard. The dashboard is lower priority since at that point we'll be getting data and I can just write a short command line script to display it and suss out the interesting bits. Given that, I might nix the dashboard idea or push it off to a separate bug.

Comment 4

[Will Kahn-Greene [:willkg] ET needinfo? me]

Items 1 and 2 landed in master in:

https://github.com/mozilla/fjord/commit/11b7212
https://github.com/mozilla/fjord/commit/919182e
https://github.com/mozilla/fjord/commit/635219e

Only thing left is to write a dashboard template that pulls the json and displays it in a way that's helpful.

Comment 5

[Will Kahn-Greene [:willkg] ET needinfo? me]

The cron jobs didn't seem to run last night. Looking into it today.

Comment 6

[Will Kahn-Greene [:willkg] ET needinfo? me]

I didn't write a dashboard template. Instead I wrote a script and put it in bin/. Why? Seemed easier to do plus I'm the only one looking at this information right now.

Going to call that good enough and mark this FIXED.