684766 - Normalize "server issue" 503 bodies

Status: RESOLVED FIXED

(Cloud Services :: Operations: Miscellaneous, task)

Description

[Richard Newman [:rnewman]]

Per discussion in IRC re Bug 684751.

[17:21] atoll: file a bug for us to change "255"
[17:22] atoll: "255" means "all backend servers are overloaded"
[17:22] atoll: which is early warning of that nagios alert there

Comment 1

[:Atoll]

note that changing this won't help much, since no firefox client currently logs the 503 error body, so this is basically only useful for the lucky few who notice

Comment 2

[:Atoll]

correction, in limited specific cases firefox writes the body into the log, for instance history engine (yay).

therefore, improve this to be human-readable for end users, prefixed with "server issue: " so that they are hinted to report to us.

Comment 3

[Richard Newman [:rnewman]]

See https://bugzilla.mozilla.org/show_bug.cgi?id=684788#c3. Morphing this.

Comment 4

[:Atoll]

replaced "255" with "server issue: pool exhausted", documented at intranet/Services/Ops/ZeusSetup, deployed dev/test/stage/scl2/phx. Need to update a table of error codes somewhere.

Comment 5

[Richard Newman [:rnewman]]

(In reply to Richard Soderberg [:atoll] from comment #4)
> Need to update a table of error codes somewhere.

Done:

https://hg.mozilla.org/services/docs/rev/a6bcd0593a69