744041 - Request for telemetry ghost-window data

Status: RESOLVED FIXED

(Mozilla Metrics :: Data/Backend Reports, defect)

Description

[Justin Lebar (not reading bugmail)]

I would like a dump of GHOST_WINDOW data from Telemetry, which may help us figure out which add-ons are causing leaks.

This has only been active in nightly for five days now, so I'm sure I'll come back later for more data.  But I'd like to do this analysis now so we can see if the data may be at all useful.

In particular, I would like:

 * Operating system
 * Build identifier
 * List of (active) add-ons
 * PAGE_FAULTS_HARD (Windows only)
 * GHOST_WINDOWS
 * All histograms starting with "MEMORY"
 * All histograms starting with "CYCLE_COLLECTOR"
 * All histograms starting with "GC"
 * All the SIMPLE_MEARSURE_ data points.

This is different from bug 733516 -- in that bug, I'm mainly interested in learning which add-ons are popular, so I want data over a long time span.  In this bug, I'm mainly interested in correlating the ghost_windows number with the list of add-ons, so I want as much data as we can get since ghost_windows was introduced.

This bug blocks a MemShrink:P1, so it's a priority for the MemShrink team.

Comment 1

["Saptarshi Guha[:joy]"]

- Time Window: 20120406 till 20120410 ,(both ends inclusive)
- Product is Firefox and channel is nightly
- Records: 68,248

There are saved as JSON objects, '\n' being the record delimiter. Can be obtained here: https://metrics.mozilla.com/protected/part-r-00027.gz

As you're probably aware, reading this in python

y=open("part-r-00027").readlines()
import json
json.loads(y[0])


Note of the 68K records only 6,386 have PAGE_FAULTS_HARD present. Others are None .
(pythons None).
Example JSON is attached

Comment 2

["Saptarshi Guha[:joy]"]

Attachment: Sample JSON

A JSON object

Comment 3

[Justin Lebar (not reading bugmail)]

Yay.  Thanks a lot!