1185714 - Cleanup DB stuff from relengapi slaveloan issues

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Justin Wood (:Callek)]

so :jdm tried to request a loan via the relengapi interface, for aws.

Turns out there are still some rough edges:

* The initial requests weren't able to file a bug (the settings for prod were wrong)
* The celery retries stopped retrying after about an hour for the manual action for some reason (Unsure why so far)
* the manual action to add to vpn also failed due to fqdn for the loan machine not already being set.
* We had one issue by me where the celery chain didn't even fire off (unsure why)

Anyway, I am doing some MySQL purging to make the table prettier...

Comment 1

[Justin Wood (:Callek)]

The following is history-sake for us, since I am doing destructive actions on a prod DB.


mysql> select * from slaveloan_history where loan_id in (23, 24, 25, 27, 28);
+----+---------+---------------------+-------------------------------------------------------------------------------------------
----------------------------------------------+
| id | loan_id | timestamp           | msg
                                              |
+----+---------+---------------------+-------------------------------------------------------------------------------------------
----------------------------------------------+
| 23 |      23 | 2015-07-20 17:13:58 | [e-mail] issued a loan request for slavetype tst-linux32-ec2 (original: 'tst-
linux32-ec2')                                 |
| 24 |      23 | 2015-07-20 17:13:59 | Filing the loan bug if needed
                                              |
| 25 |      24 | 2015-07-20 17:13:59 | [e-mail] issued a loan request for slavetype tst-linux32-ec2 (original: 'tst-
linux32-ec2')                                 |
| 26 |      24 | 2015-07-20 17:14:00 | Filing the loan bug if needed
                                              |
| 27 |      23 | 2015-07-20 17:17:00 | Filing the loan bug if needed
                                              |
| 28 |      24 | 2015-07-20 17:17:00 | Filing the loan bug if needed
                                              |
| 29 |      23 | 2015-07-20 17:20:01 | Filing the loan bug if needed
                                              |
| 30 |      24 | 2015-07-20 17:20:01 | Filing the loan bug if needed
                                              |
| 31 |      23 | 2015-07-20 17:23:01 | Filing the loan bug if needed
                                              |
| 32 |      24 | 2015-07-20 17:23:02 | Filing the loan bug if needed
                                              |
| 33 |      23 | 2015-07-20 18:37:55 | [e-mail] marked loan as complete
                                              |
| 34 |      24 | 2015-07-20 18:38:03 | [e-mail] marked loan as complete
                                              |
| 35 |      25 | 2015-07-20 18:38:12 | [e-mail] issued a loan request for slavetype tst-linux32-ec2 (original: 'tst-linu
x32-ec2-1')on behalf of [e-mail] |
| 36 |      25 | 2015-07-20 18:38:13 | Filing the loan bug if needed
                                              |
| 37 |      25 | 2015-07-20 18:38:14 | Loan is tracked in bug 1185630
                                              |
| 38 |      25 | 2015-07-20 18:38:14 | Waiting for a human to perform create_aws_system (id 1)
                                              |
| 40 |      25 | 2015-07-20 19:44:44 | Admin marked action (id: 1) as complete via web
                                              |
| 41 |      25 | 2015-07-20 20:22:40 | [e-mail] marked loan as complete
                                              |
| 42 |      27 | 2015-07-20 20:23:10 | [e-mail] issued a loan request for slavetype tst-linux32-ec2 (original: 'tst-linu
x32-ec2-1')on behalf of [e-mail] |
| 43 |      27 | 2015-07-20 20:39:35 | [e-mail] marked loan as complete
                                              |
| 44 |      28 | 2015-07-20 20:40:10 | [e-mail] issued a loan request for slavetype tst-linux32-ec2 (original: 'tst-linu
x32-ec2-1')on behalf of [e-mail] |
| 45 |      28 | 2015-07-20 20:40:11 | Filing the loan bug if needed
                                              |
| 46 |      28 | 2015-07-20 20:40:11 | Loan is tracked in bug 1185630
                                              |
| 47 |      28 | 2015-07-20 20:40:11 | Waiting for a human to perform create_aws_system (id 2)
                                              |
| 48 |      28 | 2015-07-20 20:40:32 | Admin marked action (id: 2) as complete via web
                                              |
| 49 |      28 | 2015-07-20 20:41:13 | Noticed that a human performed pending action (id 2), continuing
                                              |
| 50 |      28 | 2015-07-20 21:10:51 | [e-mail] marked loan as complete
                                              |
+----+---------+---------------------+-------------------------------------------------------------------------------------------
----------------------------------------------+
27 rows in set (0.00 sec)

mysql> delete from slaveloan_history where loan_id in (23, 24, 25, 27, 28);
Query OK, 27 rows affected (0.01 sec)

mysql> select * from slaveloan_manualactions where loan_id in (23, 24, 25, 27, 28);
+----+---------+---------------------+---------------------+-------------------+-------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
+
| id | loan_id | timestamp_start     | timestamp_complete  | complete_by       | msg

|
+----+---------+---------------------+---------------------+-------------------+-------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
+
|  1 |      25 | 2015-07-20 18:38:14 | 2015-07-20 19:44:44 | [e-mail] | Create an aws machine for [e-mail]
of the type requested (see loan history). Following https://wiki.mozilla.org/ReleaseEngineering/How_To/Loan_a_Slave#AWS_machines
|
|  2 |      28 | 2015-07-20 20:40:11 | 2015-07-20 20:40:32 | [e-mail] | Create an aws machine for [e-mail]
of the type requested (see loan history). Following https://wiki.mozilla.org/ReleaseEngineering/How_To/Loan_a_Slave#AWS_machines
|
+----+---------+---------------------+---------------------+-------------------+-------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
+
2 rows in set (0.00 sec)




mysql> select * from slaveloan_loans where id in (23, 24, 25, 27, 28);
+----+----------+---------+----------+------------+
| id | status   | bug_id  | human_id | machine_id |
+----+----------+---------+----------+------------+
| 23 | COMPLETE |    NULL |       11 |       NULL |
| 24 | COMPLETE |    NULL |       11 |       NULL |
| 25 | COMPLETE | 1185630 |       11 |       NULL |
| 27 | COMPLETE | 1185630 |       11 |       NULL |
| 28 | COMPLETE | 1185630 |       11 |       NULL |
+----+----------+---------+----------+------------+
5 rows in set (0.00 sec)

mysql> select * from slaveloan_humans where id=11;
+----+-----------------------+-----------------------+
| id | ldap                  | bugzilla              |
+----+-----------------------+-----------------------+
| 11 | [e-mail] | [e-mail] |
+----+-----------------------+-----------------------+
1 row in set (0.00 sec)

mysql> delete from slaveloan_loans where id in (23, 24, 25, 27, 28);
Query OK, 5 rows affected (0.00 sec)