676662 - Investigate missing baseline performance data

Status: RESOLVED WONTFIX

(addons.mozilla.org Graveyard :: API, defect)

Description

[Kumar McMillan [:kumar]]

The query in Performance.get_baseline() failed in production explosively: https://github.com/jbalogh/zamboni/commit/79e8507#L0R61 (see https://bugzilla.mozilla.org/show_bug.cgi?id=659794#c37 ).  Find out why we are missing this essential part of performance data.

Comment 1

[Wil Clouser [:clouserw]]

This is all handled by Alice.  What data is missing?

Comment 2

[Kumar McMillan [:kumar]]

It looks like we are only missing the baseline startup time for fx 3.6.15pre, MacOSX 10.5.8.  There were only 4 performance results for this but it must have been for some popular addons since it got triggered so much in production.

It would be nice to insert this missing baseline data but the code can assume baselines might be missing for flexibility.  That safe guard was done in bug 659794 but it needs some more testing before it goes live.

For reference, this is how to find missing baselines:

select a.app, a.version as app_version, o.os, o.version as os_version, test, max(case when r.addon_id is null then 1 else 0 end) as has_baseline, 
count(*) as num_results 
from perf_results r 
left join perf_appversions a on a.id=r.appversion_id 
left join perf_osversions o on o.id=r.osversion_id 
group by 1, 2, 3, 4, 5;

Comment 3

[Kumar McMillan [:kumar]]

Removing myself from a bunch of old AMO bugs

Comment 4

[Wil Clouser [:clouserw]]

Thanks for filing this.  Due to resource constraints we are closing bugs which we won't realistically be able to fix.  If you have a patch that applies to this bug please reopen.

For more info see http://micropipes.com/blog/2014/09/24/the-great-add-on-bug-triage/