BMO ETL: Update export script to temporaily not cache profiles daat until migration is complete from bug 1926081
Categories
(bugzilla.mozilla.org :: Extensions, defect)
Tracking
()
People
(Reporter: dkl, Assigned: dkl)
References
(Blocks 1 open bug)
Details
Attachments
(1 file)
Even with adding a default value for modification_ts, with the migration script from bug 1926081 still running in the background (very slowly), when the script starts to export the profiles and hits a similar place in the profiles table that the migration script is hitting, it causes the script to crash.
So I want to temporarily not cache profile rows in the DB and just send the data directly. When the migration is complete, we can add the caching back in. I need this to get consistent nightly exports of BMO data without crashes. Also the profiles table is not huge like the other tables so it doesn't really effect the export time significantly.
|
||
Comment 1•4 months ago
|
||
|
|
||
Comment 2•4 months ago
|
||
Authored by https://github.com/dklawren
https://github.com/mozilla-bteam/bmo/commit/d787052bcdf92e1def5a4b2f39604095c3431e65
[master] Bug 1949285 - BMO ETL: Update export script to temporaily not cache profiles daat until migration is complete from bug 1926081
|
|
||
Comment 3•4 months ago
|
||
Authored by https://github.com/dklawren
https://github.com/mozilla-bteam/bmo/commit/b11d77ab2b0c065329648e350e1cc2a8cea7429f
[master] Revert "Bug 1949285 - BMO ETL: Update export script to temporaily not cache profiles daat until migration is complete from bug 1926081"
Description
•