922606 - https://secure.pub.build.mozilla.org/buildapi intermittently returning 503 errors

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Product Delivery, task)

Description

[[e-mail] (:bhearsum)]

We've been seeing this on and off since last night and the trees are now closed for it. According to the logs on the backend server for buildapi (buildapi01.build.scl1.mozilla.com), these requests never make it through.

This site is part of releng-zlb.vips.scl3.mozilla.com, can someone have a look at the logs and such for that?

Comment 1

[Corey Shields [:cshields]]

(I've been looking into this since it came in, sorry forgot to update the bug as such)

Comment 2

[[e-mail] (:bhearsum)]

Trees were re-opened because it's not happening as much now, lowering severity (for now).

Comment 3

[Corey Shields [:cshields]]

I enabled logging on the releng and releng-https vips so hopefully we can coorelate these missing hits next time.

Comment 4

[Chris Turra [:cturra]]

closing this bug off since we have not seen the issue return for 2 weeks now.

Comment 5

[Bill Gianopoulos [:WG9s]]

(In reply to Chris Turra [:cturra] from comment #4)
> closing this bug off since we have not seen the issue return for 2 weeks now.

Ah, did you not see bug 926246?  This happened again 2 days ago.

Comment 6

[Chris Turra [:cturra]]

it wasnt obvious to me they were related. if you believe this bug should still be open, please feel free to reopen. at this point however, i am not sure what action items are required on our part aside from providing logs from the time periods these errors were observed.