1106145 - Unknown platforms are added as yet another duplicate row with every refresh

Status: RESOLVED DUPLICATE of bug 1087349

(Tree Management :: Treeherder: Data Ingestion, defect, P3)

Description

[Jonathan French (:jfrench)]

Perhaps a duplicate, or least related to bug 1104312, philor noticed unknown hg bundle jobs appear to be getting added in large quantities while treeherder sits idle. We agreed to enter it as a separate issue for now, and can be dupe'd during triage against bug 1104312 if required.

I'm including a bit of the channel transcript for context if helpful:

philor - my vague memory was that someone already patched recognizing bundles, but maybe that didn't land yet

philor - we do that hg bundle job once a week on most or all trees, but that scheduled job doesn't set a revision, so it doesn't get shown, it's just now that releng is doing the merges to aurora/beta and thus automating everything because they don't like anything manual that they've started doing the automated bundle immediately after the merge with a revision set

I'm attaching philor's screen grab of the observed behavior, when sitting leaving the platform idle.

Comment 1

[Jonathan French (:jfrench)]

Attachment: hg-bundl-opt mass entries

Comment 2

[Phil Ringnalda (:philor)]

Alas, we don't have a ready supply of unknown platforms to test with, but my feeling is that the correct summary is "Unknown platforms are added as yet another duplicate row with every refresh" and the only relationship with that particular job is that it's our only unknown platform.

Comment 3

[Gregory Szorc [:gps]]

If "hg bundle job" implies hg bundle generation, this is something we should eventually move into hg.mozilla.org itself. This is a pre-requisite of bundle-based clones.

Comment 4

[Phil Ringnalda (:philor)]

See, we *do* need a change of summary ;)

And in fact we do have another unknown platform, since we're doing (infinite retries of) 10.10 tests on https://treeherder.mozilla.org/#/jobs?repo=cedar, which also get a duplicate row added with every refresh.

Comment 6

[Ed Morley [:emorley]]

(In reply to Gregory Szorc [:gps] from comment #3)
> If "hg bundle job" implies hg bundle generation, this is something we should
> eventually move into hg.mozilla.org itself. This is a pre-requisite of
> bundle-based clones.

It's referring to the releng jobs that generate:
https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Source_Code/Mercurial/Bundles

I don't disagree that it should perhaps move to hg.m.o itself, but that's something you need to speak to releng about :-)