Closed Bug 773835 Opened 8 years ago Closed 8 years ago

New cron job list for Mobeta

Categories

(Socorro :: Backend, task)

task
Not set

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jberkus, Assigned: rhelmer)

References

Details

(Whiteboard: [mobeta][qa-])

Attachments

(1 file)

Post-mobeta, the list of Matview cronjobs will completely change.  We'll be getting rid of the OldTCBS cron jobs, and adding a bunch of new ones.

See the attached CSV file.  This should be the complete list of matview-related cron jobs in the system (it does not include things like ftpscraper).  Note that while I have update_adu and update_build_adu listed as "daily", crontabber should actually run them hourly.

FWIW, this CSV is going to become a table in the Postgres database for 19.0.
Attachment #642107 - Attachment mime type: application/octet-stream → text/plain
Blocks: 752956
So something like:

for each in (SELECT proc_name, needs_date, backfill_days FROM all_matviews):
    cursor.proc_call(...

That would make it really convenient.
However, we could also put the CSV file inside the socorro/cron/jobs/ directory and an app could load it in. That way we can control the ins and outs of matviews with git and stuff.
Peter: sure.  I need it in a table for my backfiller, but there's no reason we couldn't sync that to a CSV file periodically.
Target Milestone: --- → 18
peterbe, r? https://github.com/mozilla/socorro/pull/739
Status: NEW → ASSIGNED
So, given that we can't count on crontabber being ready for mobeta, we should create an old-style cronjob change set which covers the post-mobeta jobs.  Rhelmer?
Oh, btw, note that my list does NOT include the bugzilla cron job.
(In reply to [:jberkus] Josh Berkus from comment #4)
> So, given that we can't count on crontabber being ready for mobeta, we
> should create an old-style cronjob change set which covers the post-mobeta
> jobs.  Rhelmer?

Yep, let's get the crontabber change landed (we'll need it later) and I'll work on getting ye olde cron going.
OK here are the equivalent changes for the old cron:

https://github.com/mozilla/socorro/pull/773
Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/9574fb7ab57ae1353348f4c0362345a73155b206
bug 773835 - new matviews and dependencies

https://github.com/mozilla/socorro/commit/5ead17f0560af5398025dd4af3ca227c75fc9a0b
bug 773835 - fixes to obsolete dependencies and more verbose logging on mismatching dependencies
OS: Mac OS X → All
Hardware: x86 → All
Whiteboard: [mobeta] → [mobeta][qa-]
Status: ASSIGNED → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.