529156 - reclone try server repository

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Fetching a URL such as

http://tests.themasta.com/tinderboxpushlog/fetchraw.php?site=pushlog&url=try/pushloghtml%3Fstartdate=12+hours+ago%26enddate=now

which redirects to the pushlog for that tree takes upwards of 45s -- it makes using tbpl on the try server almost unusable.  Any way that we can speed that up?

Comment 1

[[e-mail] (:bhearsum)]

It's probably time to reclone the try repo - all the heads on it (probably over 1000 at this point) are the source of the slowdown. I'll try to do it along with another downtime this week.

Comment 2

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Ah, yeah, that would probably do it.  Any chance we can morph this bug into a way to automate that process, perhaps weekly?  A more complicated option would be to strip the heads (and preceding changesets that don't appear on any other head branches) at the same time as the builds expire from the download site.

Comment 3

[[e-mail] (:bhearsum)]

(In reply to comment #2)
> Ah, yeah, that would probably do it.  Any chance we can morph this bug into a
> way to automate that process, perhaps weekly?  A more complicated option would
> be to strip the heads (and preceding changesets that don't appear on any other
> head branches) at the same time as the builds expire from the download site.

I just filed bug 529179 for this. I don't think anyone has time to look into it yet, though. We'll do this (again) as a short term fix for now.

Comment 4

[[e-mail] (:bhearsum)]

Catlee has been working on scheduling this.

Comment 5

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

(In reply to comment #4)
> Catlee has been working on scheduling this.

Catlee: thanks for waiting for me. I've now got everything I need from the try repo logs, you can reset.

Also, per irc, reassigning to justdave for the 9am downtime.

Comment 6

[Dave Miller [:justdave]]

(In reply to comment #5)
> Also, per irc, reassigning to justdave for the 9am downtime.

I don't recall saying I could do this...  be happy to if someone provides instructions, but I have no clue how to do it otherwise...

Comment 7

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

(In reply to comment #6)
> (In reply to comment #5)
> > Also, per irc, reassigning to justdave for the 9am downtime.
> 
> I don't recall saying I could do this...  be happy to if someone provides
> instructions, but I have no clue how to do it otherwise...

From irc, sorry, this should have been to Aravind.

Comment 8

[Aravind Gottipati [:aravind]]

Done, per Ben on irc.

Comment 9

[[e-mail] (:bhearsum)]

I pushed the contents of 1.9.1, 1.9.2, tracemonkey, and electrolysis repositories to try. Places was just recently recloned from mozilla-central, so I didn't push it.

I also had to reconfig the master to fix the HgPoller. It still managed to miss the first push to the newly cloned repo.