767198 - getpersonas stage server down

Status: RESOLVED FIXED

(Cloud Services :: Operations: Marketplace, task)

Description

[Brandon Savage [:brandon]]

The getpersonas stage server (http://personas.stage.mozilla.com/en-US/) is down. The error as reported by Zeus:

Connection to 63.245.209.111 Failed

Comment 1

[Brandon Savage [:brandon]]

Any update on this issue? Two bugs have been marked as blockers, but I've had no information on the progress of this issue and I don't have access to see those bugs. This blocks bug 765170.

Comment 2

[Jason Thomas [:jason]]

This stage host was migrated from SJC1 to SCL3 during out datacenter migration however it doesn't seem like it is working properly. Instead of trying to fix this old vm that doesn't match our standard setup I am setting a new VM that is managed fully by puppet.  bug 768038 is for network flows and bug 768041 is for a netapp mount.

Comment 3

[Jason Thomas [:jason]]

Waiting on one more network flow from sphinx -> mysql so we can index search.

The new stage URL is https://getpersonas.allizom.org/

Comment 4

[Brandon Savage [:brandon]]

There seem to be errors, I'm getting blank pages from the webserver on numerous pages. Can you tell me what the logs are for POST on https://getpersonas.allizom.org/en-US/signin and GET on https://getpersonas.allizom.org/en-US/gallery/ ?

Comment 5

[Jason Thomas [:jason]]

(In reply to Brandon Savage [:brandon] from comment #4)
> There seem to be errors, I'm getting blank pages from the webserver on
> numerous pages. Can you tell me what the logs are for POST on
> https://getpersonas.allizom.org/en-US/signin and GET on
> https://getpersonas.allizom.org/en-US/gallery/ ?

/en-US/signin due to php session folder not writeable by apache, this is fixed.

blank pages due to some db acls, this is fixed as well.

Let me know if you have any other issues.

Comment 6

[Jason Thomas [:jason]]

Search should be working now. Stage is configured to update from trunk every 15 minutes.