Closed Bug 1302739 Opened 8 years ago Closed 8 years ago

Port telemetry-batch-view to Spark 2.0

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: rvitillo, Assigned: rvitillo)

References

Details

User Story

I plan to enlist help moving our jobs to Spark 2.0. I don't expect big issues but I think it makes sense that each owner schedules his jobs with Spark 2.0 through Airflow and makes sure that it works as expected.

I will file some bugs in the next days and provide one or more examples of how to schedule a Scala job from Airflow with Spark 2.0.

Attachments

(1 file)

56 bytes, text/x-github-pull-request
mreid
: review+
Dexter
: review+
mdoglio
: review+
Details | Review
      No description provided.
Attached file patch
Attachment #8791289 - Flags: review?(mreid)
Attachment #8791289 - Flags: review?(mdoglio)
Attachment #8791289 - Flags: review?(alessio.placitelli)
User Story: (updated)
Comment on attachment 8791289 [details] [review]
patch

The code looks ok and the AddonRecommender runs fine locally with your changes and Spark 2.0.
Attachment #8791289 - Flags: review?(alessio.placitelli) → review+
Attachment #8791289 - Flags: review?(mreid) → review+
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Comment on attachment 8791289 [details] [review]
patch

Sorry for the delayed review. lgtm!
Attachment #8791289 - Flags: review?(mdoglio) → review+
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: