Closed Bug 1248688 Opened 8 years ago Closed 7 years ago

[meta] ATMO V2: project tracking

Categories

(Data Platform and Tools Graveyard :: Telemetry Analysis Service (ATMO), defect, P3)

Product:
Data Platform and Tools Graveyard
Component:
Telemetry Analysis Service (ATMO)
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: azhang, Unassigned)

References

Details

From :rvitillo's project overview:

The dashboard at https://analysis.telemetry.mozilla.org/ is hard to extend and to maintain. It’s based on Flask and grew out of the need to schedule simple jobs on AWS packaged in zip files and and was later extended with the ability to launch Spark clusters and schedule Jupyter notebooks. 

The first goal of the rewrite is to make it easier in the future to extend the dashboard with new functionality. We should use Django as our platform as we have plenty of experts within Mozilla that are intimately familiar with it.

The analysis dashboard should represent the gateway for a Mozilla engineer to our data. The first milestone for this project is to support Spark analyses:
- Launch, monitor, kill, enlarge & shrink dynamic Spark clusters; current monitoring is limited to the status of the cluster but we want other information as well, such as CPU/memory/disk & IO usage. An admin interface could then display a complete overview of all clusters running.
- Track per-user resource consumption (# machines * # hours, scheduled vs. adhoc, etc.)
- Launch, monitor, kill & edit scheduled analyses.
Assignee: nobody → azhang
Points: --- → 3
Priority: -- → P3
Depends on: 1269754
No longer depends on: 1232642
Depends on: 1282818
Assignee: azhang → nobody
No longer depends on: 1269754
Depends on: 1301048
No longer depends on: 1301048
Depends on: 1301048
Depends on: 1302761
Depends on: 1302495
Depends on: 1305065
Summary: A.T.M.O Rebirth (project tracking) → ATMO V2: project tracking
Summary: ATMO V2: project tracking → [meta] ATMO V2: project tracking
Depends on: 1307831
Depends on: 1308712
Depends on: 1308713
Depends on: 1309227
Depends on: 1309504
Depends on: 1309855
Depends on: 1310157
Depends on: 1310599
Depends on: 1309569
Depends on: 1310614
No longer depends on: 1307087
Depends on: 1311284
Depends on: 1311285
Depends on: 1311288
Depends on: 1311457
Depends on: 1311467
Depends on: 1311475
Depends on: 1311634
No longer depends on: 1311708
Depends on: 1312415
Depends on: 1312423
Depends on: 1312424
No longer depends on: 1312423
Depends on: 1312426
Depends on: 1312427
Depends on: 1312428
Depends on: 1312430
Depends on: 1312983
Depends on: 1313008
Depends on: 1313031
Depends on: 1313308
Depends on: 1314273
Depends on: 1314677
Depends on: 1315271
Depends on: 1315670
Depends on: 1315681
Depends on: 1315684
Depends on: 1315696
Depends on: 1316278
Depends on: 1316286
Depends on: 1316623
Depends on: 1316626
Depends on: 1315303
Depends on: 1316890
Depends on: 1318008
Depends on: 1318319
Depends on: 1318320
Depends on: 1291697
Depends on: 1318665
Blocks: 1319077
No longer blocks: 1319077
Depends on: 1319077
Depends on: 1319545
Depends on: 1320679
Depends on: 1321358
Depends on: 1321788
Depends on: 1321984
Depends on: 1322640
Depends on: 1322759
Depends on: 1333596
Depends on: 1335109
Depends on: 1335228
Depends on: 1335441
Depends on: 1337809
Depends on: 1338163
Component: Metrics: Pipeline → Telemetry Analysis Service (ATMO)
Product: Cloud Services → Data Platform and Tools
I'm closing this bug because:

1) ~99% of the work related to this meta bug has been accomplished
2) ATMOv2 has been running for months now, and all new work is being done using the new code
3) ATMO tracking has been moved out of bugzilla and into a github issue tracker (https://github.com/mozilla/telemetry-analysis-service/issues) and waffle board (https://waffle.io/mozilla/telemetry-analysis-service).
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Product: Data Platform and Tools → Data Platform and Tools Graveyard
You need to log in before you can comment on or make changes to this bug.