Closed
Bug 1364530
Opened 8 years ago
Closed 8 years ago
Migrate Search ETL job to python_mozetl
Categories
(Data Platform and Tools :: General, enhancement, P1)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: thuelbert, Assigned: amiyaguchi)
References
Details
Attachments
(3 files)
placeholder, actual steps (version control, monitoring etc) to be added.
|
||
Comment 1•8 years ago
|
||
This job would be a good candidate for moving to python_mozetl.
|
||
Updated•8 years ago
|
Summary: We need to productionize the search job → Migrate Search ETL job to python_mozetl
|
Assignee | |
Comment 2•8 years ago
|
||
|
|
Assignee | |
Comment 3•8 years ago
|
||
|
|
Assignee | |
Comment 4•8 years ago
|
||
I've added pull requests to the corresponding repositories to add a minimally modified version of the search rollup to mozetl and schedule it on airflow. This brings the job into a repository, making changes easier to review and merge.
This job still needs to hit some subset of the following points:
* Backfill all failed dates from May 8 - May 14/15
* Use the execution date passed by airflow in rollup to enable backfill
* Exercise code paths via unit testing
* Remove custom alerting in lieu of airflow alerts, log relevant information to logfiles/stdout
|
|
Assignee | |
Updated•8 years ago
|
Assignee: nobody → amiyaguchi
Points: --- → 2
Priority: -- → P1
|
|
Assignee | |
Comment 6•8 years ago
|
||
|
||
Comment 7•8 years ago
|
||
Shall we close the following bugs as duplicates of this one:
https://bugzilla.mozilla.org/show_bug.cgi?id=1365578
https://bugzilla.mozilla.org/show_bug.cgi?id=1365580
|
|
||
Updated•8 years ago
|
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
|
||
Updated•4 years ago
|
Component: Datasets: Search → Datasets: General
|
|
||
Updated•2 years ago
|
Component: Datasets: General → General
You need to log in
before you can comment on or make changes to this bug.
Description
•