1021128 - Data missing from main-thread I/O dashboard

Status: RESOLVED FIXED

(Webtools Graveyard :: Telemetry Server, defect)

Description

[Vladan Djeric (:vladan)]

1. I don't see any data in the "shutdown" view for any of the weeks.
2. The current week's data is missing

Comment 1

[Mark Reid [:mreid]]

I checked a few of the run logs, and the scheduled data export job has been OOMing more and more frequently, resulting in missing data.

Comment 2

[Roberto Agostino Vitillo (:rvitillo)]

Mark, are we getting more submissions now that a month ago that might explain the OOMing or did something change in our mapreduce platform?

Comment 3

[Mark Reid [:mreid]]

the number of submissions appears to be stable, and nothing of note has changed with the mapreduce platform - I landed PR #55 which added a "--profile" option, but it shouldn't add any overhead unless you include that (new) argument.

Comment 4

[Roberto Agostino Vitillo (:rvitillo)]

Mark, the OOM error should be fixed. After the job scheduled for today runs successfully to completion, could you please rerun it on the data of the past week with my last changes?

Comment 5

[Mark Reid [:mreid]]

Per discussion on IRC, the debugging for this problem is ongoing, but is hopefully fixed now.  I'm waiting to hear back about the latest execution run, and if it looks good I will start backfilling data.

Comment 6

[Mark Reid [:mreid]]

I'm working on backfilling the data for the past 2 weeks.