931906 - Port Chromehang export to new telemetry backend

Status: RESOLVED FIXED

(Webtools Graveyard :: Telemetry Server, defect)

Description

[Mark Reid [:mreid]]

We want to continue to provide chromehang data for analysis, so we'll need to port the Hadoop based export over to the AWS backend.

The script that runs the export on the old system is here:
https://github.com/mozilla-metrics/telemetry-toolbox/blob/master/src/main/sh/daily-telemetry-chromehangs.sh

Comment 1

[Mark Reid [:mreid]]

I've created an initial data export for chromehangs:
https://github.com/mozilla/telemetry-server/commit/0e9d8a0e2bbd43d78c734917ee476d02c399ba5a

Comment 2

[Mark Reid [:mreid]]

Vladan, what did you have in mind for a dashboard for this data?

Do you still have the code used for this analysis:
https://blog.mozilla.org/vdjeric/2013/04/09/current-state-of-firefox-chrome-hangs/

Comment 3

[Vladan Djeric (:vladan)]

I still have the code for that analysis but it's very messy and I was planning to rewrite it before we switched Telemetry backends, so we should probably start from scratch. However, I can send you the details of the heuristics I used to generate stack signatures (for grouping similar stacks).

For the first cut of the chrome-hang dashboard, I'd like to see:

a) Similar stacks grouped and counted together i.e. stack signatures. When displaying the signature in the dash, it might be nice to only show the top 4 or 5 frames and have it expand when clicked. Include the library name next to the function name or just include the library name once and use color-coding to indicate which frames belong to which library
b) for each signature, its ping count and frequency (same as main-thread IO dashboard), the median hang duration, median firefox uptime + median system uptime at time of the hang
d) all the other dashboard functionality we have in existing dashboards: sort by column + filters for application/channel/version + top X + weekly change in rank

Comment 4

[Mark Reid [:mreid]]

Initial dashboard deployed here:
http://telemetry.mozilla.org/chromehangs/