Since Friday's updates, I've been seeing a large number of problems with the mission control dev server. It is quite strange -- I'm seeing a lot of errors regarding atomic transactions not completing with the update_builds tasks and when I ssh'ed in to the dev environment I saw this query was hung:
21088 | 2 days 21:04:51.222387 | read_write | SELECT "django_migrations"."app", "django_migrations"."name" FROM "django_migrations"
I'm not sure exactly what this is about, I think it's something Django just runs on start up. The suspicious part is that it seems to have been hung for almost 3 days.
Looking at new relic, it appears we're getting errors coming from the fact that more recent versions of Django expect you to wrap create operations that may fail inside transaction.atomic:
I'm not sure if this explains the problems we're seeing, but I have a PR to fix this issue-- we'll see how it goes after that lands: