Closed Bug 725482 Opened 14 years ago Closed 9 years ago

Refactor Backfill Matviews script to make it more maintainable

Categories

(Socorro :: Database, task)

x86
macOS
task
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX
Future

People

(Reporter: jberkus, Unassigned)

Details

Currently the backfill_matviews() function is a linear SQL script which is simply extended each time we add a new matview which needs to be backfilled. This worked fine when we had 4 matviews, but has become unsustainable. I am currently working on making a table-driven version of backfill_matviews which will rely on a table of matviews to be updated, a python script and a PostgreSQL function. This will be maintainable by simply adding a new matview definition to the matviews table each time you create one.
Bumping to 2.5.1 because of ESR.
Target Milestone: 2.4.4 → 2.5.1
Bumping to 2.5.2, since it's not done yet.
Target Milestone: 2.5.1 → 2.5.2
Still not working correctly. Bumped.
Target Milestone: 2.5.2 → 2.5.3
Target Milestone: 3 → 4
Target Milestone: 4 → 5
Target Milestone: 5 → 6
Target Milestone: 6 → 7
Code not ready to go for version 7. May get postponed in favor of getting a test infrastructure working.
Target Milestone: 7 → 9
Target Milestone: 9 → Future
This needs to be done immediately after Mobeta. about 50% complete now.
Target Milestone: Future → 19
Have installed workaround for mobeta. As suck, bumping this to version 21.
Target Milestone: 19 → 21
Bumping to 23 so that I can reassign to Selena
Assignee: josh → sdeckelmann
Target Milestone: 21 → 23
Josh, Is there a branch with the unfinished refactored code in it? Thanks!
No ... it's on jberkus/socorro. I pushed the unfinished code to sql/upgrade/backfill.
Target Milestone: 23 → 24
Target Milestone: 24 → Future
Assignee: sdeckelmann → nobody
linear backfill_matviews is sustainable enough for our foreseeable future
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.