Closed Bug 1264332 Opened 8 years ago Closed 8 years ago

Investigate/verify the proportion of invalid crash pings in the crash aggregates job.

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: azhang, Assigned: azhang)

References

(Depends on 1 open bug)

Details

Although only 0.06% of all pings are ignored by the crash aggregates job, we don't know what percentage of this are crash pings.

I will be investigating how these ignored pings impact the data.

In a random sample of 50000 *crash* pings, 3 of them are ignored. I expect that these ignored pings will not be an issue.

I've added a few counters to the crash aggregates job to get some better numbers. It will complete in ~3 hours.
Assignee: nobody → azhang
Depends on: 1257321
current sprint = p1
Priority: -- → P1
After looking through ~400M pings, this appears to be working correctly:

> SUCCESSFULLY COMPUTED CRASH AGGREGATES FOR 2016-04-12
> SUCCESSFULLY UPLOADED CRASH AGGREGATES FOR 2016-04-12 TO S3
> ========================================
> JOB COMPLETED SUCCESSFULLY
> 424812681 main pings processed, 280652 main pings ignored
> 3250411 crash pings processed, 1014 crash pings ignored
> ========================================
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.