1137490 - Please setup cron to update Content Svcs data weekly

Status: RESOLVED FIXED

(Content Services Graveyard :: Tiles: Data Processing, defect)

Comment 1

[Edwin Wong [:edwong]]

Tim - logging this to track this task so it doesn't get lost.

Comment 2

[Tim Spurway [:tspurway]]

thanks, :edwong.  I will get this to you before March 6th.

Comment 3

[Hamilton]

For external data on this dashboard (not the data Tim is making), I have a script that pulls vertica data from the v2 rollups and outputs into the following directories on app1:

/home/hulmer/tmp/dashboards/content-services/up_fhr_weekly_data.csv 
/home/hulmer/tmp/dashboards/content-services/up_fhr_last_updated.json

These are ready to be slurped up into s3. Ali is taking care of the dashboard data integration.

Apologies if this is not the location in which to discuss this, but these technically count as "external metrics" and we don't have a bug set for these.

Comment 4

[Edwin Wong [:edwong]]

any updates here.

Comment 5

[Edwin Wong [:edwong]]

Tim said he's going to work on this tonight

Comment 6

[Edwin Wong [:edwong]]

any updates?

Comment 7

[Ed Lee :Mardak]

Sorry about the delays, we've been swamped with meetings. I'll ping tspurway.

Comment 8

[Tim Spurway [:tspurway]]

The code is in staging.  The cron config is set up.  I think we can go to prod tomorrow.  Anything else we need ed?

Comment 9

[Ed Lee :Mardak]

(In reply to Tim Spurway [:tspurway] from comment #8)
> The code is in staging.  The cron config is set up.  I think we can go to
> prod tomorrow.  Anything else we need ed?
If it's working on stage, we just need a bug filed to deploy 0.1.37 to prod.

Comment 10

[Edwin Wong [:edwong]]

are we live yet? If not - when do we expect it to be live?

most of the data is from 3/2
https://metrics.services.mozilla.com/content-services-dashboard/data/

Comment 11

[Tim Spurway [:tspurway]]

Hey :edwong - we are uploading manually until we can get the cron running.