694170 - OrangeFactor should recognise intermittent failures from jobs that were builds

Status: RESOLVED DUPLICATE of bug 1179316

(Tree Management Graveyard :: OrangeFactor, defect)

Description

[cmtalbert]

We are failing all over the place (mozilla-central, even) in bug 673017.  However, no data is available for this bug in orange factor, which seems terribly wrong.  Can we dig in and see what's going on here?

Comment 1

[Jonathan Griffin (:jgriffin)]

This is because we don't parse build logs for the results of make check tests.  We can add that, it would take a day or so.  Shall I?

Comment 2

[cmtalbert]

Oh for some reason I was thinking it was an xpcshell test. I don't think it's that important to get check tests running, since I think 99% of them are passing fine.  Let's back burner this.  We can revisit it if there is more need.

Comment 3

[Ed Morley [:emorley]]

This affects the following failures, several of which are common at the moment:

http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=814164&entireHistory=true&tree=all

http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=816061&entireHistory=true&tree=all

http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=774844&entireHistory=true&tree=all

http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=753223&entireHistory=true&tree=all

...and from comment 0:

http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=673017&entireHistory=true&tree=all

Comment 4

[Ed Morley [:emorley]]

Also bug 817268:
http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=852299&entireHistory=true&tree=trunk

Comment 5

[Ed Morley [:emorley]]

And bug 861176:
http://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=861176&entireHistory=true&tree=trunk

Comment 6

[Ed Morley [:emorley]]

And bug 886079:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=886079&entireHistory=true&tree=trunk

Comment 7

[Ed Morley [:emorley]]

Wontfix in favour of OrangeFactor v2 which will consume Treeherder's API, and likely be written from scratch.

Comment 8

[Ed Morley [:emorley]]

This will be fixed in bug 1179316; it's now more practical to do so that we're not using logparser.