Closed Bug 1579446 Opened 5 years ago Closed 5 years ago

[test isolation] Improve test detection in isolate_test.py action

Categories

(Testing :: General, enhancement)

enhancement
Not set
normal

Tracking

(firefox71 fixed)

RESOLVED FIXED
mozilla71
Tracking Status
firefox71 --- fixed

People

(Reporter: bc, Assigned: bc)

Details

Attachments

(1 file)

isolate_test.py determines which tests have failed by loading and parsing the errorsummary.log artifact for a job. It currently uses just the "test" "property" although some tests, such as web platform, place some information in the "message" "property".

I've tested a change to the algorithm using errorsummary logs from 8/1 through 9/5 and have improved the ability to detect the failing tests while reducing false positives.

Pushed by bclary@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/2a4f864fdeb8
[test isolation] Improve test detection in isolate_test.py action, r=gbrown
Status: ASSIGNED → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla71
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: