706642 - [input] Send tracebacks to arecibo

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Input is getting noisy, can we add:


ARECIBO_SERVER_URL = 'http://arecibo1.dmz.phx1.mozilla.com/'

to settings/local.py on dev, stage and prod

Comment 1

[Ashish Vijayaram [:ashish]]

Assigning to :jakem who's on push duty this week.

Comment 2

[Jake Maul [:jakem]]

Deployed on dev, prod, and stage.

I'm afraid stage may have issues as it's in SJC1, whereas dev and prod are in PHX1. If it does, let us know and we can investigate.

Comment 3

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Thanks

Comment 4

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

(In reply to Jake Maul [:jakem] from comment #2)
> Deployed on dev, prod, and stage.
> 
> I'm afraid stage may have issues as it's in SJC1, whereas dev and prod are
> in PHX1. If it does, let us know and we can investigate.

Haven't tested stage, but from dev I'm having issues:

I can't even  ping arecibo1.dmz.phx1.mozilla.com.

Comment 5

[Justin Dow [:jabba]]

I think sjc1 has its own arecibo server (might be a VM though), so perhaps stage could point to arecibo1.dmz.sjc1.mozilla.com instead of phx1.

Comment 6

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Yeah it does, and can point there, that works for stage, but dev is in phx and should be able to hit it.

Comment 7

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Bumping this, we're getting slammed with 500s, and this could help us prioritize a lot.

I can verify that dev can't hit arecibo1.dmz.phx1.mozilla.com, so that needs to be fixed, can we also verify if prod can hit there?  I assume not, since I'm not seeing any notification.  Thanks.

Comment 8

[Jake Maul [:jakem]]

This should all be fixed now.