1577828 - Create ETL for TrendKite

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, task, P2)

Description

[Edward Cho]

In order to monitor earned media impressions, we need to export data out of TrendKite. This will require adding API access to the vendor agreement, and creating the necessary ETL to ingest exported data into a marketing project BQ table (or set of tables).

Comment 1

[Jeff Klukas [:klukas] (UTC-4)]

Adding Melissa as it sounds like this will require some data ops work to get permissions in order.

Is somebody already working on the vendor agreement side of this? Who handles that sort of negotiation?

:echo - From the discussion I heard last week on this topic, it sounds like there is some pre-built integration either on the TrendKite side or GCP side for getting TrendKite data to GCP. Can you give some details about where to start with that?

Comment 2

[Edward Cho]

:klukas I am getting the ball rolling to take inventory on our current vendor agreement. As I recall, there is a minimal export API that we can activate, but no out-of-box GCP integration. More to come after our vendor agreement is modified...

Comment 3

[Mark Reid [:mreid]]

Edward, any update on this? Please re-assign this bug to me when we're ready to take next steps.

Comment 4

[:shell escalante]

is this still valid? useful? changing to P5 until hear otherwise

Comment 5

[Edward Cho]

The high-level requirement is still valid but not a high priority. Also unsure if this contract is still valid. I will circle back with that info.

Comment 6

[Rob Miller [:rmiller]]

Hello,

The Mozilla Data Engineering organization is currently going through our extensive backlog, consisting of hundreds of issues stretching back for nearly 10 years. We've done a pass through all of the open bugzilla bugs and have identified and tagged the ones that we think are relevant enough to still need attention. The rest, including the bug with which this comment is associated, we are closing as "WONTFIX" in a single bulk operation.

If you feel we have closed this (or any) issue in error, please feel free to take the following actions:

• Reopen the bug.
• Edit the bug to add the string [dataplatform] (including the brackets) to the Whiteboard field. (Note that you must edit the Whiteboard, not the similarly named QA Whiteboard.)

Doing this will ensure that we see the bug in our weekly triage process, where we will decide how to proceed.

Thank you.

Comment 7

[Rob Miller [:rmiller]]

Hello,

The Mozilla Data Engineering organization is currently going through our extensive backlog, consisting of hundreds of issues stretching back for nearly 10 years. We've done a pass through all of the open bugzilla bugs and have identified and tagged the ones that we think are relevant enough to still need attention. The rest, including the bug with which this comment is associated, we are closing as "WONTFIX" in a single bulk operation.

If you feel we have closed this (or any) issue in error, please feel free to take the following actions:

• Reopen the bug.
• Edit the bug to add the string [dataplatform] (including the brackets) to the Whiteboard field. (Note that you must edit the Whiteboard, not the similarly named QA Whiteboard.)

Doing this will ensure that we see the bug in our weekly triage process, where we will decide how to proceed.

Thank you.