[OrangeFactor v2] Reconcile difference between TestFailures and OrangeFactor

NEW
Assigned to

Status

Testing
ActiveData
9 months ago
4 months ago

People

(Reporter: ekyle, Assigned: ekyle)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

9 months ago
The TestFailures dashboard sees the test-level intermittent failures.  This is not all failures, there are job-level failures that can be seen in TH that can not be seen in TestFailures.  ActiveData has the job level failures, and they plan to be shown using the TestFailures dashboard also.  The test-level failures will be subtracted from the job-level failures to leave a residue which needs to be explored before OFv2 can replace OF.

To do this, bug and star information from TH is required.  Finding the pattern in the residue will involve testing set operations (queries) over both datasets to establish the heuristics that explain the difference between TestFailures and Treeherder/OrangeFactor.   This will be a continuous process over several months, so recent data is best.
(Assignee)

Updated

9 months ago
Depends on: 1296634
No longer depends on: 1296634
(Assignee)

Updated

4 months ago
Depends on: 1296634
You need to log in before you can comment on or make changes to this bug.