Make JSON files available from the Hello dashboard accessible without persona authentication

RESOLVED FIXED

Status

P1
normal
RESOLVED FIXED
4 years ago
2 months ago

People

(Reporter: RT, Assigned: whd)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
The JSON files available on the Hello dashboard (https://metrics.services.mozilla.com/loop-server-dashboard/) are used for reporting on Google spreadsheets although since they require persona authentication the JSON data cannot be collected automatically from the spreadsheet, making the reporting on separate spreasheet very manual.
This bug is to remove the persona authentication on JSON file access.
A way forward may be to push the JSON files to an S3 drive (we may re-use our existing S3 drive used for TokBox data).

Updated

4 years ago
Component: Operations: Metrics/Monitoring → Metrics: Pipeline
(Reporter)

Comment 1

4 years ago
Katie, could you lease point us to someone who could help implement this?
Flags: needinfo?(kparlante)

Comment 2

4 years ago
Romain: its now in our triage queue.
Assignee: nobody → whd
Flags: needinfo?(kparlante)

Updated

4 years ago
Priority: -- → P1
(Assignee)

Comment 3

4 years ago
https://github.com/mozilla-services/puppet-config/pull/1413

The files are updated daily and available to people with credentials for s3://net-mozaws-prod-metrics-data/loop-server-dashboard, which I can provide.
(Reporter)

Comment 4

4 years ago
Thanks Wesley. The intention here is to access the files from a Google spreadsheet, is-it possible with the authentication solution in place?
(Assignee)

Comment 5

4 years ago
http://engetc.com/projects/amazon-s3-api-binding-for-google-apps-script/ seems to be a possible solution for accessing the files in S3 from a Google spreadsheet. If you need unauthenticated HTTP(S) access, you can use the credentials I provide to sync the files somewhere and serve them from there.

Comment 6

4 years ago
Echoing what whd said, you should be able to write scripts that pull the files from S3. Some resources:

- Command line tool: https://github.com/aws/aws-cli 
- Documentation for using S3 from aws-cli: http://docs.aws.amazon.com/cli/latest/reference/s3/index.html
- Boto is the python sdk: https://github.com/boto/boto3

You guys will have to figure out the details, but accessing data via s3 is an industry standard and shouldn't present odd barriers the way persona auth does.
(Reporter)

Comment 7

4 years ago
Thanks Wesley and Katie!
Jorge can you please confirm it provides you what you need for the spreadsheet integration?
Flags: needinfo?(jorge.munuera)

Comment 8

3 years ago
marking as resolved, please re opening in the even this is not meeting your needs.
Status: NEW → RESOLVED
Iteration: --- → 42.3 - Aug 10
Last Resolved: 3 years ago
Resolution: --- → FIXED

Updated

3 years ago
Flags: needinfo?(jorge.munuera)

Updated

2 months ago
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.