1155886 - Add mau_data to set of files being pushed to S3

Status: RESOLVED FIXED

(Cloud Services :: Metrics: Dashboard, defect)

Description

[Ali Almossawi]

I've already chatted with Sheeri about this, but I'm creating a bug for the sake of visibility.

We need /home/hulmer/tmp/dashboards/main/mau_data.csv on app1 to be pushed to https://metrics.services.mozilla.com/data in order for the MAU chart on the landing page to be in sync with the MAU chart on the Desktop dashboard.

The script is here: https://github.com/mozilla/exec-dashboard-data-pulling-scripts/blob/master/pull_mau_data.py

Comment 1

[Ali Almossawi]

Hi Sheeri, I'm terribly sorry to have to bother you during the weekend, but seeing as the dashboards are going live on Monday, would it be possible to push the updated file before then? Thanks.

Comment 2

[Sheeri Cabral [:sheeri]]

Working on this now. 

Also, if you want to get me on a weekend, try texting me - #'s in phonebook.

Comment 3

[Sheeri Cabral [:sheeri]]

I've uploaded it to  s3://net-mozaws-prod-metrics-data/mau_data.csv but I'm not seeing the data updated.

Comment 4

[Ali Almossawi]

I can confirm that the MAU chart on the landing page is now showing the correct data. Thank you.

Comment 5

[Wesley Dawson [:whd]]

There's some special case logic for the landing page. Data meant for that page should go to s3://net-mozaws-prod-metrics-data/dashboards-landing-page/data/. I manually copied the file there (which is why Ali sees correct data) and will clean up s3.

Comment 6

[Wesley Dawson [:whd]]

Correction to my previous comment: s3://net-mozaws-prod-metrics-data/dashboards-landing-page/mau_data.csv is the correct place for this data. I deleted the following versions:

s3://net-mozaws-prod-metrics-data/./mau_data.csv
s3://net-mozaws-prod-metrics-data//usr/local/exec_dashboards/data/mau_data.csv
s3://net-mozaws-prod-metrics-data/data/mau_data.csv
s3://net-mozaws-prod-metrics-data/mau_data.csv

Comment 7

[Ali Almossawi]

Is there a reason why the values for "mobile" all turned to 0? They're all properly populated in the source file on app1: /home/hulmer/tmp/dashboards/main/mau_data.csv

Comment 8

[Ali Almossawi]

whd fixed the issue by manually updating the csv.

To clarify, the script that auto-deploys the file would be replacing the csv at metrics.services.mozilla.com/data/mau_data.csv

Comment 9

[Sheeri Cabral [:sheeri]]

whd - thanx, I put it in dashboards-landing-page/data now and ran the script manually, the 19:30 timestamp is the updated one.

In the future it will be great to get the s3 place, as whd illuminated in comment 6. (or say "the same place as script X")