Closed Bug 1174269 Opened 9 years ago Closed 9 years ago

Autophone - increase stderrp_reject from 10 to 50% in perftests

Categories

(Testing Graveyard :: Autophone, defect)

defect
Not set
normal

Tracking

(firefox41 affected)

RESOLVED FIXED
Tracking Status
firefox41 --- affected

People

(Reporter: bc, Assigned: bc)

References

Details

Attachments

(1 file)

Attached patch bug-xxx-v1.patchSplinter Review
Autophone is spending too much time retesting builds which have one or more measurements which exceed the current stderrp_reject limit of 10%. If we increase the limit to 50%, it appears we will eliminate about 80% of the retests. I do not think this will materially effect the ability to distinguish regressions or improvements and will hopefully help Autophone keep up with current builds.
Attachment #8621737 - Flags: review?(gbrown)
Blocks: 1174271
Attachment #8621737 - Flags: review?(gbrown) → review+
https://github.com/mozilla/autophone/commit/383b090b2244a989137895f481c3a19c526aa7a7
Assignee: nobody → bob
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Product: Testing → Testing Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: