908211 - Gaia repository on gitmirror.mozilla.org is stuck on an old revision

Status: RESOLVED FIXED

(Developer Services :: Mercurial: hg.mozilla.org, defect)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

It appears that the git mirror hasn't updated the gaia repository for ~9 days. This has meant the B2G performance tests have only been tracking changes to Gecko for over a week...

From http://gitmirror.mozilla.org/

mozilla-b2g/gaia - 1a38ad4

I have tried manually triggering the WebHook in github, but the revision doesn't appear to be updating. We need to get this updated and ideally add some monitoring so that we can prevent this recurring.

Comment 1

[Stephen Donner [:stephend] Not actively reading bugmail]

bkero, any chance you could help out with this?

Comment 2

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

1) The gaia repo on git.m.o is correctly updating (at this time now at 2bee65), and also has RelEng+IT monitoring on it. Can we switch over whatever test automation is using "gitmirror.mozilla.org:/mozilla-b2g/gaia" to instead use the supported and monitored "git.mozilla.org:/releases/gaia.git"?

2) The git.m.o server and mirroring code already has support and monitoring. What is gitmirror.mozilla.org used for? Is there anything on gitmirror.m.o that is missing from git.m.o? Can we migrate any remaining users off gitmirror.m.o and shut it down to reduce duplication of effort, and reduce confusion?

Comment 3

[Dumitru Gherman [:dumitru]]

I found a bunch of stale git processes, and among that in the error_log:
[Sun Aug 18 09:23:03 2013] [error] Updating https://github.com/mozilla-b2g/gaia.git => mozilla-b2g/gaia.
[Sun Aug 18 09:23:03 2013] [error] cd /var/repos/git/mozilla-b2g/gaia && git fetch
error: cannot create pipe for git-remote-https: Too many open files

I restarted Apache and xinetd, but I am not sure how to trigger a refresh.

Comment 4

[u429623]

(In reply to Dave Hunt (:davehunt) from comment #0)
> It appears that the git mirror hasn't updated the gaia repository for ~9
> days. This has meant the B2G performance tests have only been tracking
> changes to Gecko for over a week...
> 
> From http://gitmirror.mozilla.org/
>
> We need to get this updated and ideally add
> some monitoring so that we can prevent this recurring.

gitmirror.mozilla.org is a "convenience" system to buffer some internal IT systems from github outages.

The production quality service, which has monitoring already, is git.mozilla.org. git.mozilla.org should always be used for product work. For anything b2g, all repos are mirrored as needed to git.mozilla.org, and all builds use those servers.

I'll file a bug to get the QA systems connected to the production repositories. The "convenience" system is back up to date, so resolving this one.

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Thanks Hal, I've updated these jobs to use the git.mozilla.org server now.