1822151 - Logic in treeherder to analyze "TV" results and report properly

Status: NEW

(Tree Management :: Treeherder, task)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

Treeherder has the ability to mark a test as passed (Green) or failed (Orange, etc.), and before it is in that state it is pending (light grey) or running (dark grey)

This bug should:

1. upon failure determine next step (bug 1822145)
2. trigger verify | retrigger - if that is next step
3. leave jobs as dark grey if retrigger || verify is running
4. analyze the results of all the tests and make a determination if the failure is failure || unknown || intermittent
5. for a status of intermittent turn the job green or autoclassify it (or some new status)
6. for failure || unknown mark the job as failed (orange)

there is logic for what to run and how to interpret it in:
https://docs.google.com/document/d/1GyvZqbfqoMnZ0OWkrQBzaTTT-nA_w8oHuaXNaZzrb14/edit

Ideally an end state would be:

• tasks remain in grey state no more than 30 extra minutes
• 90% of errors are resolved as intermittent