Airflow is terminating the job after 36000 seconds. Historically it has taken less than 10000 seconds to complete. There are no interesting errors coming out of EMR and no failure/corruption errors from hbase. Snippet from stdout emr log: [0m[[0minfo[0m] [0mPackaging /mnt/analyses/telemetry-batch-view/target/scala-2.11/telemetry-batch-view-1.1.jar ...[0m [0m[[0minfo[0m] [0mDone packaging.[0m [0m[[32msuccess[0m] [0mTotal time: 150 s, completed Aug 30, 2017 7:00:11 AM[0m Processing 20170829... I do see data for 20170829 but it may not be completed. It's possible that we are hitting some performance issues with hbase so I will investigate that first.
This job has been deprecated, closing.
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → INVALID
Product: Data Platform and Tools → Data Platform and Tools Graveyard
You need to log in before you can comment on or make changes to this bug.