Closed Bug 1042127 Opened 11 years ago Closed 11 years ago

hitting ISE 500's while pulling from hg.m.o to buildbot repos across our masters. buildbot hgpollers also failing

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task)

Product:
Infrastructure & Operations Graveyard
Component:
CIDuty
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: jlund, Unassigned)

References

Details

09:04:58 <bhearsum> hwine-coffee: hg seems like it's in bad shape again today. lots of ISE 500s when updating masters in a reconfig, and one of our release jobs failed after hanging during a push 09:21:57 <bhearsum> 88692 2014-07-22 09:19:25-0700 [-] <HgPoller for https://hg.mozilla.org/projects/larch>: polling failed, result Getting https://hg.mozilla.org/projects/larch/json-pushes? full=1 took longer than 30 seconds.
I found a stuck push for releases/l10n/mozilla-beta/vi and killed the process, then manually resynced it
tyvm! I'll close for now and open if we hit issues with reconfigs/hgpolling again
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Blocks: 1042210
on second thought, I'll re-open until we find no further issues throughout today/tomorrow. specifically my concern being ISE 500s as it was brought to attention we hit 500s before we started our tagging pushes this morning. So the stuck mozilla-beta push might not be the whole issue.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
I did not see any errors in further reconfigs. No reason to keep open.
Status: REOPENED → RESOLVED
Closed: 11 years ago → 11 years ago
Resolution: --- → FIXED
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.