From :rvitillo's project overview: The dashboard at https://analysis.telemetry.mozilla.org/ is hard to extend and to maintain. It’s based on Flask and grew out of the need to schedule simple jobs on AWS packaged in zip files and and was later extended with the ability to launch Spark clusters and schedule Jupyter notebooks. The first goal of the rewrite is to make it easier in the future to extend the dashboard with new functionality. We should use Django as our platform as we have plenty of experts within Mozilla that are intimately familiar with it. The analysis dashboard should represent the gateway for a Mozilla engineer to our data. The first milestone for this project is to support Spark analyses: - Launch, monitor, kill, enlarge & shrink dynamic Spark clusters; current monitoring is limited to the status of the cluster but we want other information as well, such as CPU/memory/disk & IO usage. An admin interface could then display a complete overview of all clusters running. - Track per-user resource consumption (# machines * # hours, scheduled vs. adhoc, etc.) - Launch, monitor, kill & edit scheduled analyses.
2 years ago
Assignee: nobody → azhang
Currently, code + docs live at https://github.com/Uberi/telemetry-analysis-service
Summary: A.T.M.O Rebirth (project tracking) → ATMO V2: project tracking
Summary: ATMO V2: project tracking → [meta] ATMO V2: project tracking
Component: Metrics: Pipeline → Telemetry Analysis Service (ATMO)
Product: Cloud Services → Data Platform and Tools
I'm closing this bug because: 1) ~99% of the work related to this meta bug has been accomplished 2) ATMOv2 has been running for months now, and all new work is being done using the new code 3) ATMO tracking has been moved out of bugzilla and into a github issue tracker (https://github.com/mozilla/telemetry-analysis-service/issues) and waffle board (https://waffle.io/mozilla/telemetry-analysis-service).
Status: NEW → RESOLVED
Last Resolved: 9 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.