648737 - Add-on developers need access to the raw results of performance measurements

Status: RESOLVED WONTFIX

(addons.mozilla.org Graveyard :: Public Pages, defect)

Description

[Wladimir Palant]

Right now, add-on developers are left with only a meaningless number of the "badness" of their add-on. AMO should provide them with at least absolute numbers for each platform, ideally also with the results of individual measurements on these platforms and a link to the log. This would help understanding cases like Flashgot's where the add-on performs very badly on one platform and prints error messages to the log which might indicate the cause.

Comment 1

[alice nodelman [:alice] [:anode]]

I believe that this would just be an alteration for the AMO UI.  Talos reports all results to the tinderbox log for each test, so it should be possible to provide links to those logs.

Alternatively, we do send all the raw data to the graph server for processing (seen here https://wiki.mozilla.org/Buildbot/Talos/DataFormat#AMO).  If the AMO team is interested in using that raw data directly we can insert it into new tables in their db.

cc'ing wclouser for an opinion.