hbase_main_summary airflow job timing out

RESOLVED INVALID

Status

RESOLVED INVALID
a year ago
2 months ago

People

(Reporter: jason, Assigned: jason)

Tracking

Details

(Assignee)

Description

a year ago
Airflow is terminating the job after 36000 seconds. Historically it has taken less than 10000 seconds to complete. There are no interesting errors coming out of EMR and no failure/corruption errors from hbase.

Snippet from stdout emr log:
[0m[[0minfo[0m] [0mPackaging /mnt/analyses/telemetry-batch-view/target/scala-2.11/telemetry-batch-view-1.1.jar ...[0m
[0m[[0minfo[0m] [0mDone packaging.[0m
[0m[[32msuccess[0m] [0mTotal time: 150 s, completed Aug 30, 2017 7:00:11 AM[0m
Processing 20170829...

I do see data for 20170829 but it may not be completed.

It's possible that we are hitting some performance issues with hbase so I will investigate that first.
(Assignee)

Updated

a year ago
See Also: → bug 1402322
This job has been deprecated, closing.
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → INVALID

Updated

2 months ago
Product: Data Platform and Tools → Data Platform and Tools Graveyard
You need to log in before you can comment on or make changes to this bug.