Closed Bug 585645 Opened 14 years ago Closed 14 years ago

more httpd gateway errors from hg.mozilla.org

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Platform:
x86
macOS
Type:
task
Priority:
Not set
Severity:
critical

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: bhearsum, Assigned: aravind)

Details

Just got a abort: HTTP Error 504: Gateway Time-out from about 20 builds around the same time.

Did we ever figure out the source of these issues?
Assignee: server-ops → aravind
A couple notes from IRC:
504 Gateway Time-out generally means that the backend machine (in this case, one of the hg.mozilla.org heads) doesn't return data in time. It doesn't usually indicate a problem with the proxy.

We're running nginx as our HTTP proxy here.
Should be fixed now.

dm-vcview04 was swapping.  I reduced the varnish cache to 18G, and reduced the tmpfs size from 2.5 to 2G (try clone is only about 1.1G, so we should be fine).  Restarted varnish and apache.

We should watch this carefully to see if we swap again (when the varnish cache fills up in a few days).

Also Ben filed bug 585657 to add the dm-vcview* servers to munin.
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.