852995 - please investigate possible db event on March 13th

Status: RESOLVED FIXED

(Data & BI Services Team :: DB: MySQL, task)

Description

[[e-mail] (:bhearsum)]

We had a db row get into a state that seems impossible on March 13th. The row in question is in the generic-rw-zeus.db.phx1.mozilla.com/ship_it_mozilla_org database, in the fennec_release table, identified by the name "Fennec-20.0b5-build1".

Here's the timeline:
Within 30s of 16:12:11 PT - the 'ready' column gets set to 1.
At 16:22:36 PT - the 'complete' column gets set to 1.

Sometime between those two events 'ready' is set to 0. I can't explain how this happened through the exposed web form/api - it would be great to explain this away through something on the server side if possible.

Comment 1

[Sheeri Cabral [:sheeri]]

Hrm, on March 15th and 18th we did a bunch of maintenance on the generic servers (defragmented tbpl) and because of that, the earliest change logs we have are from March 16th. I thought maybe the inconsistent state was because of the maintenance, but the maintenance started 2 days after the problem occurred. :(

Comment 2

[[e-mail] (:bhearsum)]

No worries. If we see this again I'll ask for info right away instead of waiting a week. Thanks for taking a look, though!