1642554 - Implement model for engineer traction formula

Status: RESOLVED FIXED

(Tree Management :: Perfherder, task, P1)

Description

[Ionuț Goldan [:igoldan]]

Engineer traction formula is as follows:

• Tries to answer the question: how much interest do Firefox engineers have for a particular test, by looking at the bugs filed for it?
• All bugs except NEW -- vs total filed bugs
• Considers only
  • bugs filed by perf sheriffs
  • bugs that date back to last quantifying period
  • bugs’ state by the end of the 2nd week
  • bugs that are at least 2 weeks old

You can find more details in its official specification.

Basically, this formula will see how many regression bugs changed their status & resolution in the first 2 weeks since the bug was filed. It'll divide those against the total bugs filed for a particular framework/suite/test combo (e.g. talos tp5o_webext XRes).

We'll obviously need to query Bugzilla.
Don't think we'll need to setup a Bugzilla API key, as we don't require more than the public data.

Comment 1

[Kyle Lahnakoski [:ekyle]]

There is an ActiveData instance with all SNAPSHOTS of the public bugs over time. It will require an upgrade to the latest version to handle the specific query you are interested in.

https://activedata-public.devsvcprod.mozaws.net/tools/query.html#query_id=d4n8Z9WV