601740 - buildbot JSON should be generated at higher frequency and with less latency

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P4)

Description

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

A problem I've run into building a tinderboxpushlog replacement off of the data in http://build.mozilla.org/builds/ is that the JSON files there are updated only every 5 minutes, and the updates tend to be pushing data that's already 10 minutes or so old.

If we want a production-quality TBPL replacement to be based on the data there, they need to be more up-to-date.

Comment 1

[[e-mail] (:bhearsum)]

assigning to Catlee for prioritization.

Comment 2

[Markus Stange [:mstange]]

Is this just a matter of tweaking one number, or would it create load problems? If so, would shortening the time span help? For example, we could replace builds-4hr.js.gz with builds-10min.js.gz; generating that might be faster and could done at a higher frequency.
It would also waste less time on the TBPL side. TBPL's import script imports builds-4hr.js.gz every 5 minutes, so it only really uses 2% of that data most of the time.

Comment 3

[Chris AtLee [:catlee]]

(In reply to comment #2)
> Is this just a matter of tweaking one number, or would it create load
> problems? If so, would shortening the time span help? For example, we could
> replace builds-4hr.js.gz with builds-10min.js.gz; generating that might be
> faster and could done at a higher frequency.
> It would also waste less time on the TBPL side. TBPL's import script imports
> builds-4hr.js.gz every 5 minutes, so it only really uses 2% of that data
> most of the time.

It's mostly a matter of load, although that seems to be much better now that we fixed our redis cache. (http://people.mozilla.org/~catlee/sattap/79452b19.png)

I'll increase the frequency to once a minute, and we'll see how the machine behaves.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

FYI, there is an every-2-minute cron job that pulls the files to build.m.o, but we can get changed or move to a push model if necessary.

Comment 5

[Chris AtLee [:catlee]]

I think I changed that to run every minute.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

So you did. Carry on!

Comment 7

[Chris AtLee [:catlee]]

60 seconds ought to be enough for anybody.