If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Update OrangeFactor Robot comments for very high frequency bugs

RESOLVED FIXED

Status

Tree Management
OrangeFactor
RESOLVED FIXED
7 months ago
6 months ago

People

(Reporter: gbrown, Assigned: gbrown)

Tracking

Details

Attachments

(1 attachment)

(Assignee)

Description

7 months ago
This month we want to change policy such that failures happening 75+ times/week are skipped after 1 week. We should update the robot comments to reflect that.
(Assignee)

Comment 1

7 months ago
Examples from test run:
-------------------
# Bug 1343520:
77 failures in 804 pushes (0.096 failures/push) were associated with this bug in the last 7 days. 

This is the #15 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 77
...
-------------------
# Bug 1339062:
54 failures in 804 pushes (0.067 failures/push) were associated with this bug in the last 7 days. 

This is the #26 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 29
...
-------------------
# Bug 1341146:
10 failures in 804 pushes (0.012 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
...
(Assignee)

Comment 2

7 months ago
Created attachment 8843497 [details] [diff] [review]
update priority messages for woo_commenter

If 75+ failures/week, 1 week's disabling notice.
If 30-74 failures/week, 2 weeks' disabling notice.

See comment 1 for sample output.

I intend to have this deployed next week so the first new weekly notice would go out around March 12.
Attachment #8843497 - Flags: review?(jmaher)
Attachment #8843497 - Flags: review?(jmaher) → review+
(Assignee)

Comment 3

7 months ago
https://hg.mozilla.org/automation/orangefactor/rev/5c74a2f26b23600137ac5ff476cb9a5018ce0291

Updated

7 months ago
Depends on: 1344765
(Assignee)

Comment 4

7 months ago
Discussed in https://groups.google.com/forum/#!topic/mozilla.dev.platform/EeN78p_2PGw .

Updated

6 months ago
Depends on: 1346237

Comment 5

6 months ago
Deployed :-)
Status: NEW → RESOLVED
Last Resolved: 6 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.