Closed Bug 681476 Opened 13 years ago Closed 12 years ago

stop collecting frame data in PG

Categories

(Socorro :: General, task)

x86
macOS
task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jberkus, Assigned: jberkus)

References

Details

(Whiteboard: [qa-])

Despite the fact that we no longer use frame data anywhere in the Socorro UI, we are continuing to accumulate it in PostgreSQL, to the tune of 3GB per week.  We should stop this.

Steps to correct:

0. Approve getting rid of frames data from Postgres (Laura, Kairo)
1. Modify processors to stop inserting into frames (lars)
2. modify cronjob to stop partitioning frames (rhelmer)
3. Drop frames table (jberkus)
0: a=laura
Assignee: laura → lars
Target Milestone: --- → 2.3.1
Commit pushed to https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/f55cca401613a71c9b72113a6a2f513f2e3b82a5
Merge pull request #77 from twobraids/master

Bug 681476 - stopped the processor from writing to the frames table.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Above resolution does not make it clear whether the cronjobs have been modified or not.  Certainly I have not yet dropped the tables.

As such, reopening.  Will pick up this bug when rhelmer gets back.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: 2.3.1 → 2.4
Thanks jberkus: looking at the notes from comment 0 we still need to implement.

2. modify cronjob to stop partitioning frames (may be done but haven't verified yet)
3. Drop frames table
Component: Socorro → General
Product: Webtools → Socorro
Target Milestone: 2.4 → 2.4.2
This is waiting on configman, which we will probably get in 2.4.1
waiting on deployment of Bug 701253 or :lonnen's cron system
Assignee: lars → nobody
Blocks: 701253
No longer blocks: 701253
Assignee: nobody → josh
Depends on: 701253
Target Milestone: 2.4.2 → 2.4.3
Script written for this and checked in.
CHanges deployed to crash-stats-dev.
Status: REOPENED → RESOLVED
Closed: 13 years ago12 years ago
Resolution: --- → FIXED
Not testable by QA, since Frames have not been visible for some time.
Whiteboard: [qa-]
Reopening this.  Dropping the frames table failed in production due to deadlocks.  This needs to be rewritten so that it drops the foreign keys first, then the table.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: 2.4.3 → 2.4.4
Going to do this in prod on 3/1, that's in bug 731698.
Status: REOPENED → RESOLVED
Closed: 12 years ago12 years ago
Resolution: --- → FIXED
This was done on 3/1
You need to log in before you can comment on or make changes to this bug.