822275 - processing request for missed crashes

Status: RESOLVED FIXED

(Socorro :: Data request, task)

Description

[K Lars Lohn [:lars] [:klohn]]

A perfect storm on Beethoven's Birthday caused the socorro monitor to fail to send 160K crashes to the processors.  We need to have those crashes processed and then the aggregate reports backfilled.

To get Socorro to process these crashes, insert the attached list of crash_ids into the priority_jobs table in Postgres.  The monitor will send them on to the processors.

Comment 1

[K Lars Lohn [:lars] [:klohn]]

Attachment: gzipped list of crash_ids for reprocessing

Comment 2

[Sheeri Cabral [:sheeri]]

Changed each line to INSERT INTO priorityjobs VALUES('uid');

Running it with:

[postgres@tp-socorro01-master01 ~]$ psql  breakpad -f /tmp/missing_crash_ids.txt 

And even as soon as inserts started, the processers started working. Will check the count(*) of that table and when it's down to 0 I'll re-run the backfill.

Comment 3

[Sheeri Cabral [:sheeri]]

backfill complete, memcached restarted. Let me know if there's more to do.