Closed Bug 453457 Opened 11 years ago Closed 11 years ago

HgPoller tends to get stuck (never finish the current poll) when hgweb is down

Categories

(Release Engineering :: General, defect, major)

x86
Linux
defect
Not set
major

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: benjamin, Assigned: bhearsum)

References

Details

Last night I pushed a change to hg.mozilla.org/try that never got built:

http://hg.mozilla.org/try/pushloghtml?tipsonly=1

And in fact jimb appears to have done a push also since then which wasn't built either.
There was some downtime on hg.m.o last night, I think. I'll have a look through the logs.
Looks like HgPoller got hung up. I'll restart the master and it should pick up your builds. Getting a lot of ' Not polling <HgPoller for http://hg.mozilla.orgtry> because last poll is still working' in the log - do we need to pass the getPage calls a timeout or something?
Ah, unfortunately you're going to have to push again.
Here's where we got hung up:
2008-08-31 20:02:51-0700 [-] Polling Hg server at http://hg.mozilla.org/try/index.cgi/pushlog?tipsonly=1

This poll never finished, and never timed out.

Aravind, do you know if hg.m.o went down around that time?
Assignee: nobody → bhearsum
Status: NEW → ASSIGNED
Priority: -- → P3
Fixing up the summary + severity. Whenever this happens it forces us to restart the affected masters.
Severity: normal → major
Priority: P3 → --
Summary: Tryserver didn't build on push to hg.mozilla.org/try → HgPoller tends to get stuck (never finish the current poll) when hgweb is down
Assignee: bhearsum → nobody
Patch in bug 452102
Assignee: nobody → benjamin
Fix landed in CVS. Pushing back to bhearsum to update and restart the tryserver master.
Assignee: benjamin → bhearsum
Alright, I've updated hgpoller on production-master, staging-master, qm-moz2-unittest01, and sm-try-master and reconfig'ed the Buildbot masters on them. We shouldn't have any more problems with HgPoller dying.

Thanks for fixing that Benjamin.
Status: ASSIGNED → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Depends on: 452102
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.