1712185 - Bulk update in redash for search_clients_daily -> search_clients_engines_sources_daily

Status: RESOLVED FIXED

(Data Platform and Tools Graveyard :: Operations, task)

Description

[Jeff Klukas [:klukas] (UTC-4)]

As captured in https://jira.mozilla.com/browse/DS-1613 we are deploying new names for search_clients_daily and mobile_search_clients_daily views, and would like to remove the old views on June 22.

mconnor indicated that he has hundreds of Redash queries on top of search_clients_daily and would appreciate if we can do a bulk update.

I believe Jason may have done such before, perhaps by manipulating the STMO database?

Do we have any sense of the feasibility and level of effort to perform such a bulk update of redash queries?

Comment 1

[Wesley Dawson [:whd]]

I spoke to :robotblake and both he and :jason have done this operation before (indeed via DB manipulation), so it's probably relatively low effort. We'll discuss priority next week but I'm sure we'll be able to get to it before June 22.

Comment 2

[Jeff Klukas [:klukas] (UTC-4)]

Extra details relevant to this effort:

• The underlying tables are search_derived.search_clients_daily_v8 and search_derived.mobile_search_clients_daily_v1; we are not changing the names of those tables, so queries that are directly referencing them can remain untouched
• References to the search.search_clients_daily view should be changed to search.search_clients_engines_sources_daily
• References to the search.mobile_search_clients_daily view should be changed to search.mobile_search_clients_engines_sources_daily

Comment 3

[Jeff Klukas [:klukas] (UTC-4)]

I wanted to check in on this to see where it sits in the SRE queue. Is it likely we'll be able to make these changes before the currently scheduled deletion date of June 22?

Comment 4

[Jason Thomas [:jason]]

Yes, I will take a look at this early next week.

Comment 5

[Jason Thomas [:jason]]

https://github.com/mozilla-services/dataops/pull/59

Comment 6

[Jason Thomas [:jason]]

Attachment: search_clients_daily_2021-06-15.txt

Query ids for search.search_clients_daily to search.search_clients_engines_sources_daily

Comment 7

[Jason Thomas [:jason]]

Attachment: mobile_search_clients_daily_2021-06-15.txt

Query ids for search.mobile_search_clients_daily to search.mobile_search_clients_engines_sources_daily

Comment 8

[Jason Thomas [:jason]]

This is done. I've spot checked a couple of query ids and things looked okay. I've made a backup of the sql if we need to restore for some reason.