Bug 910614 (log-SnR)

[meta] Improve the SnR of the log error summaries by reducing spurious errors in the log

NEW
Unassigned

Status

Testing
General
5 years ago
2 years ago

People

(Reporter: emorley, Unassigned)

Tracking

(Depends on: 3 bugs)

Trunk
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

5 years ago
When a job runs, buildbot uses a number of criteria to determine whether it passed or failed (and if failed, with what state). TBPL imports this result & then parses the stdout using another set of regex [1] in order to generate a failure summary - which is what is displayed when clicking on the job in the main UI & is also used to generate the search terms for the bug suggestions for intermittent failures.

However, there are times when this summary's SnR is pretty poor:
1) Certain strings in the log are falsely matching against the TBPL regex, even though they weren't the real failure that caused the run to not succeed - distracting people from the real failure lines.
2) Some failure modes result in many garbage lines that don't add much to the understanding of the failure (eg return codes when we already have a stack, or logcat entries that are identical to the already output failure line).

This bug is to track reducing the cases of both #1 and #2 - and will primarily need changes to test harnesses/parts of automation as opposed to TBPL (since the regex is already about as good as we can get it).

[1] https://hg.mozilla.org/webtools/tbpl/file/tip/php/inc/GeneralErrorFilter.php
(Reporter)

Updated

5 years ago
Depends on: 907650
(Reporter)

Updated

5 years ago
Depends on: 813989
(Reporter)

Updated

5 years ago
Depends on: 910389
(Reporter)

Updated

5 years ago
Depends on: 920191
(Reporter)

Updated

4 years ago
Depends on: 927387
(Reporter)

Updated

4 years ago
Depends on: 943474
(Reporter)

Updated

4 years ago
Depends on: 944364
(Reporter)

Updated

4 years ago
Depends on: 982600
(Reporter)

Updated

4 years ago
Depends on: 967318
(Reporter)

Updated

4 years ago
Depends on: 991692
(Reporter)

Updated

4 years ago
Depends on: 1006511
(Reporter)

Updated

4 years ago
Depends on: 1017559
(Reporter)

Updated

4 years ago
Depends on: 1019038
(Reporter)

Updated

4 years ago
Depends on: 1026469
(Reporter)

Updated

4 years ago
Depends on: 1027597
(Reporter)

Updated

4 years ago
Depends on: 1028947
(Reporter)

Updated

4 years ago
Depends on: 1032872
(Reporter)

Updated

4 years ago
Depends on: 1047330
(Reporter)

Updated

4 years ago
Depends on: 1048182
(Reporter)

Updated

4 years ago
No longer depends on: 1032872
(Reporter)

Updated

4 years ago
Depends on: 1053197
(Reporter)

Updated

4 years ago
Depends on: 1059255
(Reporter)

Updated

4 years ago
Depends on: 1063583
(Reporter)

Updated

3 years ago
Depends on: 1078409
(Assignee)

Updated

3 years ago
Product: Webtools → Tree Management
(Reporter)

Updated

3 years ago
Summary: [meta] Improve the SnR of the TBPL annotated summary (mainly by reducing spurious errors in the log) → [meta] Improve the SnR of the TBPL/Treeherder annotated summary (mainly by reducing spurious errors in the log)
(Reporter)

Updated

3 years ago
Depends on: 1091309
(Reporter)

Updated

3 years ago
Depends on: 1123706
(Reporter)

Updated

3 years ago
Depends on: 1139827
(Reporter)

Updated

3 years ago
Alias: TBPL-SnR → log-SnR
Component: TBPL → General
Product: Tree Management → Testing
Summary: [meta] Improve the SnR of the TBPL/Treeherder annotated summary (mainly by reducing spurious errors in the log) → [meta] Improve the SnR of the log error summaries by reducing spurious errors in the log
(Reporter)

Updated

3 years ago
Depends on: 1191514
(Reporter)

Updated

2 years ago
Depends on: 1220941
(Reporter)

Updated

2 years ago
Depends on: 1244746
You need to log in before you can comment on or make changes to this bug.