636288 - Create Cron Job for updating first reports and signaturedims

Status: RESOLVED FIXED

(Socorro :: General, task, P1)

Description

[[:jberkus] Josh Berkus]

Please create a python wrapper and cron job for updating the first appearance of signature information, as well as updating signature_productdims.  

This cron job should run on the same schedule as the TCBS cron job, i.e. once per hour, for a period 3 hours in the past.

This is the SQL you call:  
SELECT update_signature_matviews( some_time, hours_back, hours_window )

example:

SELECT update_signature_matviews( '2011-02-14 16:00:00', 3, 2 );

IMPORTANT: this cron job REPLACES the signature_productdims cronjob, which currently runs once per day.   Once this cron job is deployed, that one MUST be disabled.

Comment 1

[Robert Helmer [:rhelmer]]

Attachment: replace old signatureProductDims

There were some inconsistencies in the old signatureProductDims naming, just replace it all with "signatures" as the name (cron_signatures.sh, scripts/startSignatures.py, socorro/cron/signatures.py).

I don't have update_signature_matviews() in my dev DB , I've tested that it works up to the point of throwing an error about this :) Is there a bug for getting that in schema.py? I don't have it in my current bug queue.

Comment 2

[Robert Helmer [:rhelmer]]

Comment on attachment 514863 [details] [diff] [review]
replace old signatureProductDims

Committed revision 2961.

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

What's left to do here, Rob?  Comment 2 has it landed, yet bug 636375 is still happening.

Comment 4

[Robert Helmer [:rhelmer]]

(In reply to comment #3)
> What's left to do here, Rob?  Comment 2 has it landed, yet bug 636375 is still
> happening.

Waiting on bug 636570 to get this running on stage (which is why I haven't marked this resolved yet).

Comment 5

[Stephen Donner [:stephend] Not actively reading bugmail]

Oh yes, sorry, it does that that dependency; my bad.

Comment 6

[Robert Helmer [:rhelmer]]

This ran as expected, but waiting on 1.7.7 schema updates (bug 636620).

Comment 7

[Robert Helmer [:rhelmer]]

This is now running on stage, ready for QA.

Comment 8

[Matt Brandt [:mbrandt]]

Can you lay out the steps for QA to verify. I'm not sure how to attack this one?

Comment 9

[Robert Helmer [:rhelmer]]

(In reply to comment #8)
> Can you lay out the steps for QA to verify. I'm not sure how to attack this
> one?

It's a little behind-the-scenes, I think that because bug 636375 is working, this can be inferred to be working. 

Josh or Jabba, are these tables checked via any of our existing nagios scripts?

Comment 10

[[:jberkus] Josh Berkus]

Rob,

We just check that the cron jobs are returning success.  

I'm not entirely sure how we would otherwise check the tables with nagios, since they're not current-time-based.