601728 - buildbot JSON output should have consistent categories/branches

Status: RESOLVED DUPLICATE of bug 586664

(Release Engineering :: General, defect, P3)

Description

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

The buildbot JSON output at http://build.mozilla.org/builds/ should contain category data that is consistent across builds-pending.js, builds-running.js, builds-4hr.js, and builds-YYYY-MM-DD.js.

Right now there is a lot of weird variation in categories between pending/running and completed builds.  For example:
 * l10n builds are part of "mozilla-central", etc., in pending/running but have their own category in completed
 * try server builds are "tryserver" in completed and "try" in pending/running
 * I think some mobile builds may have similar issues as l10n, at least for try

And I've probably missed some issues.

Having http://hg.mozilla.org/users/dbaron_mozilla.com/buildbot-json-tools/file/tip/filter-buildbot-json.py have logic to fix up all of these issues doesn't seem like it will extend well to future situations; it would be superior if the correct categories were in the data in the first place.

Comment 1

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

Actually, I think I just realized that builds-pending and builds-running are grouped based on the "branch" field rather than the "category" field (except for the nanojit-central runs, which differ by whether "projects/" is included).

So maybe this is less of a problem than I thought.

Comment 2

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

Actually, the branch values are only slightly less inconsistent than the category values.  I think they only differ from category when category == "idle".

Comment 3

[[e-mail] (:bhearsum)]

assigning to Catlee for prioritization.

Comment 4

[Chris AtLee [:catlee]]

See also bug 586664

Comment 6

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

See the functions branch_for_pending_running and branch_for_completed in http://hg.mozilla.org/users/dbaron_mozilla.com/buildbot-json-tools/file/tip/filter-buildbot-json.py for the various issues I've hit.