911190 - Security Review of new Telemetry server

Status: RESOLVED WORKSFORME

(Toolkit :: Telemetry, defect)

Description

[Mark Reid [:mreid]]

Work is underway on a new Telemetry data acquisition and storage system, which will replace the current production system (Bagheera -> HBase).

Point of Contact: :mreid or :taras
Description: Build a new backend for Telemetry data that is simple, fast, and reliable.
More Details: https://wiki.mozilla.org/Telemetry/Reboot and https://etherpad.mozilla.org/telemetry-reboot
Urgency: We plan to go live on Sept. 31, so ideally secreview can happen well ahead of that.

> Does this feature or code change affect Firefox, Thunderbird or any product or service the Mozilla ships to end users?
No - it is a backend change only.  Its interface will be compatible with the current system (Bagheera)

> Are there any portions of the project that interact with 3rd party services?
Yes, the server will run on Amazon EC2 instances, and data will be stored in S3

> Will your application/service collect user data? If so, please describe
Yes, the server's function is to collect and store Telemetry data submitted by Firefox / Fennec etc.

Desired review date:  September 3rd.  Please include :mreid, :taras, :yvan

Comment 1

[Mark Reid [:mreid]]

Forgot to link to the code itself:
https://github.com/mreid-moz/telemetry-server

Comment 2

[Yvan Boily [:ygjb][:yvan]]

Security testing scheduled on 2013-09-23 and 24.

https://bugzilla.mozilla.org/show_bug.cgi?id=911190

Comment 3

[Mark Reid [:mreid]]

The code to spin up a telemetry-server instance on AWS is here:
https://github.com/mreid-moz/telemetry-server/blob/master/aws_provisioning/launch_telemetry_server.py

If you don't have AWS credentials, I can spin up an instance for testing, just let me know.