Closed Bug 1286242 Opened 8 years ago Closed 8 years ago

Migrate "core" ping parquet job to telemetry-batch-view and integrate with AirFlow

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P2)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: gfritzsche, Assigned: mdoglio)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

[telemetry-airflow] mozilla:bug-1286242-add-core-ping-job > mozilla:master
52 bytes, text/x-github-pull-request
rvitillo
: review+
Details | Review 
Currently this is a scheduled notebook based on this AFAICT:
https://github.com/mfinkle/user-data-analytics/blob/master/mobile-clients.ipynb

This powers the re:dash table mobile_clients.
If it was properly integrated into AirFlow, we could also hang off the fennec-dashboard update jobs from it.
Blocks: 1286255
Points: --- → 3
Priority: -- → P3
Assignee: nobody → mdoglio
Status: NEW → ASSIGNED
Priority: P3 → P2
Attachment #8780562 - Flags: review?(rvitillo)
Depends on: 1295104
Blocks: 1295658
Blocks: 1295659
The job is now running on airflow. Rewriting it using telemetry-batch-view is a completely different job and I would eventually defer it to a separate bug.
Status: ASSIGNED → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
I opened bug 1295996 to cover the conversion to scala.
Attachment #8780562 - Flags: review?(rvitillo) → review+
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: