540301 - Fix / rebuild a new ETL monitorization tool

Status: RESOLVED FIXED

(Mozilla Metrics :: Frontend Reports, defect)

Description

[Pedro Alves]

The existing dashboard for etl monitorization has some problems that are related to data access issues (see bug 540300). 

We need not only to fix those data access issues but also rebuild this dashboard in a way that quickly allows us to spot issue in our servers and prevent situations like what happened in the nightly report of 16/Jan.

Comment 1

[Daniel Einspanjer [:dre] [:deinspanjer]]

Guys, we have released the 3.6 major update notification.  People really want to see some trends on downloads down to the minute or hour level.  The download ETL dashboard has not worked since the Pentaho 3.5 upgrade.  Is there *any* way we can get this dashboard or something like it running to show a simple trend line of data in download_requests_raw?

Comment 2

[Pedro Alves]

Link to 'Firefox 3.6 Downloads' dashboard:

https://metrics.mozilla.com/pentaho/content/pentaho-cdf-dd/Render?solution=metrics&path=/downloads/downloads_notification&file=downloads_notification.wcdf

Comment 3

[Daniel Einspanjer [:dre] [:deinspanjer]]

Also fixed with the new health dashboard (too slow)
https://metrics.mozilla.com/pentaho/content/pentaho-cdf-dd/Render?solution=metrics&path=/status_etl/etl_health&file=etl_health.wcdf