1622927 - Please test latest migration script against prod

Status: RESOLVED FIXED

(Cloud Services :: Operations: Miscellaneous, task, P1)

Description

[Rachel Tublitz [:rachel]]

We made a few changes to the sync migration script since our last test that we think might move the needle in terms of timing. Specifically, sorting by primary key.

Can we get some help running another test against production using the latest migration script here?

What we're interested in here is:

1. How long do we estimate it taking to migrate a single node?
2. Does the original 3-6 nodes rough estimate per day still apply assuming we see changes here?

Comment 1

[Erik Olson]

@JR Are there any changes to the usage of the script?

Comment 2

[JR Conlin [:jrconlin,:jconlin]]

Discussed this offline.

The branch that we've been using was rebased, which caused @eolson a bit of trouble. I've provided guidance to assist in (hopefully) clearing the conflicts.

Operationally, there should be no changes required. The script automatically tries to order users not by their userID but by their fxa_uid, which is part of their primary spanner key.

Comment 3

[Erik Olson]

About half the performance of the previous test:

BSO #19: 15316782 rows; 358.417 mins; 712.243 rows/s
BSO #8: 15564871 rows; 359.6 mins; 721.397 rows/s
BSO #15: 15995445 rows; 361.717 mins; 737.015 rows/s
BSO #0: 16850455 rows; 362.45 mins; 774.84 rows/s
BSO #5: 15863694 rows; 362.533 mins; 729.298 rows/s
BSO #3: 16576005 rows; 362.667 mins; 761.765 rows/s
BSO #9: 16512913 rows; 362.967 mins; 758.238 rows/s
BSO #7: 16139048 rows; 363.067 mins; 740.867 rows/s
BSO #13: 16928426 rows; 363.783 mins; 775.573 rows/s
BSO #18: 16023671 rows; 363.883 mins; 733.92 rows/s
BSO #14: 16353794 rows; 363.967 mins; 748.869 rows/s
BSO #17: 15580092 rows; 364.083 mins; 713.211 rows/s
BSO #6: 15857726 rows; 364.117 mins; 725.854 rows/s
BSO #4: 16266066 rows; 364.133 mins; 744.511 rows/s
BSO #12: 16888780 rows; 364.55 mins; 772.129 rows/s
BSO #11: 19716345 rows; 364.617 mins; 901.236 rows/s
BSO #16: 15342621 rows; 364.933 mins; 700.704 rows/s
BSO #10: 17019913 rows; 365.517 mins; 776.066 rows/s
BSO #2: 17241711 rows; 365.683 mins; 785.822 rows/s
BSO #1: 15954855 rows; 367.367 mins; 723.839 rows/s