Closed Bug 434118 Opened 17 years ago Closed 17 years ago

runtests.py script is unfair

Categories

(Tamarin Graveyard :: Tracing Virtual Machine, defect)

x86
Windows XP
defect
Not set
major

Tracking

(Not tracked)

VERIFIED FIXED

People

(Reporter: mohammad.r.haghighat, Assigned: dschaffe)

Details

Attachments

(1 file)

runtests.py script favors AVM over AVM2 when comparing two AVMs across several runs using its "-i n" option. On a given test, it runs the two AVMs "n" times, picks the "best" run of AVM and the "last" run of AVM2, and compares these two results. A patch is attached. The patch compares the best runs of AVM and AVM2. It also adds an extra column in the output to report the speedup.
This patch makes runtests.py fair when compaing AVM and AVM2. Previously, the script favored AVM over AVM2, as it always picked the best run of AVM and the last run of AVM2 when multiple runs were requested using "-i" option.
Assignee: nobody → dschaffe
Attachment #321348 - Attachment is patch: true
Attachment #321348 - Flags: review?(dschaffe)
Attachment #321348 - Flags: review?(dschaffe) → review+
submitted patch in 499251ed3b76 : 369 rev, thanks for patch.
Status: NEW → RESOLVED
Closed: 17 years ago
Resolution: --- → FIXED
cleaning up old bugs. moving from resolved/fixed to verified/fixed to close it.
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: