Closed Bug 1255730 Opened 10 years ago Closed 10 years ago

Telemetry aggregation job is failing

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rvitillo, Assigned: rvitillo)

Details

Telemetry aggregation job is failing with that seems to be an OOM caused error: Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe. : org.apache.spark.SparkException: Job 4 cancelled because SparkContext was shut down
It seems that the problem is not due OOM but due to a high number of tasks. For some reason Spark 1.5 didn't have an issue with it but 1.6 does. I enforced a maximum limit in [1] and I am currently backfilling the missing data. I am going to close this bug if the job terminates successfully. [1] https://github.com/mozilla/python_moztelemetry/commit/ce8bf67eb355e9898bd05d07d6fa9f29e6bc1735
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.