Autophone - increase stderrp_reject from 10 to 50% in perftests

RESOLVED FIXED

Status

RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: bc, Assigned: bc)

Tracking

Trunk
Points:
---

Firefox Tracking Flags

(firefox41 affected)

Details

Attachments

(1 attachment)

(Assignee)

Description

3 years ago
Created attachment 8621737 [details] [diff] [review]
bug-xxx-v1.patch

Autophone is spending too much time retesting builds which have one or more measurements which exceed the current stderrp_reject limit of 10%. If we increase the limit to 50%, it appears we will eliminate about 80% of the retests. I do not think this will materially effect the ability to distinguish regressions or improvements and will hopefully help Autophone keep up with current builds.
Attachment #8621737 - Flags: review?(gbrown)
(Assignee)

Updated

3 years ago
Blocks: 1174271

Updated

3 years ago
Attachment #8621737 - Flags: review?(gbrown) → review+
(Assignee)

Comment 1

3 years ago
https://github.com/mozilla/autophone/commit/383b090b2244a989137895f481c3a19c526aa7a7
Assignee: nobody → bob
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.