https://login.anosrep.org/wsapi/session_context not responding/completing GET request

VERIFIED FIXED

Status

Cloud Services
Operations
--
major
VERIFIED FIXED
3 years ago
3 years ago

People

(Reporter: stephend, Assigned: relud)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [fromAutomation], URL)

(Reporter)

Description

3 years ago
The GET request for https://login.anosrep.org/wsapi/session_context never seems to finish (or, at least times out, in the end, but never completes).

STR:

1. Load http://beta.123done.org/
2. Wait for the "Sign in with your email" button

Actual:

It never appears -- the AJAX spinner remains

Expected:

Compare with http://123done.org/, which loads the button just fine

In talking with :jrgm on IRC:

10:31:00 PM 
<
jrgm> 
stephend: yeah, so that would be https://login.anosrep.org/wsapi/session_context not responding

This is breaking out BIDPOM tests on staging, which are now publicly available:

https://webqa-ci.mozilla.com/view/BIDPOM/
Yeah, so, :relud, that would most likely mean a problem with the webhead being able to connect to the readonly databases. 

I could look into this, but not really sure I'd be looking at the right boxes. :relud, I should catch up with you tomorrow about this.
I should add, the connection problem wouldn't be credentials related, but more a network layer problem. Maybe an SG change?
(Assignee)

Comment 3

3 years ago
yeah, i'm trying to update deployments, and last nights didn't go well. this should be fixed some time today. thanks for the bug report!
Status: NEW → ASSIGNED
(Assignee)

Comment 4

3 years ago
got the new deployments working, and this appears to be fixed now.
Status: ASSIGNED → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
Yeah, so nothing got started on the webheads it appears. On the box that I *think* is the stage webhead, I tried to do `sudo systemctl start persona-browserid.service`, but that crashed with "can't open database: Error: Access denied for user 'persona-ro'@'%' to database 'persona'".

I dunno, maybe puppet didn't run completely?
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Assignee)

Comment 6

3 years ago
yeah, puppet had some issues. I think they are all resolved now.
Sorry, but still not running ok. The webheads are network-blocked from sending requests to the dbwriter (the sockets get stuck in SYN_SENT). Some sg is not enabled.
(Assignee)

Comment 8

3 years ago
okay, pretty sure it's working this time. i can create account, verify account, login to account, logout of account, delete account, login with yahoo, and login with gmail.
(Reporter)

Comment 9

3 years ago
(In reply to Daniel Thornton [:relud] from comment #8)
> okay, pretty sure it's working this time. i can create account, verify
> account, login to account, logout of account, delete account, login with
> yahoo, and login with gmail.

Thx, Daniel - it is indeed: https://webqa-ci.mozilla.com/view/BIDPOM/job/bidpom.stage.saucelabs/61/

Verified FIXED.
Status: REOPENED → RESOLVED
Last Resolved: 3 years ago3 years ago
Resolution: --- → FIXED
(Reporter)

Updated

3 years ago
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.