572867 - performance runtests: have a more succinct two-vm output mode

Status: VERIFIED FIXED

(Tamarin Graveyard :: Tools, defect)

Description

[Chris Peyer]

from edwin:
to view the results of a two-VM, multiple-iteration run, you need 170 columns.  this makes it difficult to communicate about results (email & bugzilla unfriendly text formatting)

Comment 1

[Chris Peyer]

Attachment: reformat to fit output within 80 columns

Clean up output for runtests.  New class var testFieldLen sets the amount of columns to allow for the testname - currently is not editable but would be very easy to add a commandline param.  Also includes some code cleanup in areas that I was editing.

Comment 2

[Chris Peyer]

Attachment: minor update to make patch apply properly

Comment 3

[Chris Peyer]

pushed to redux: http://hg.mozilla.org/tamarin-redux/rev/c705f998093b

Comment 4

[Edwin Smith]

Comment on attachment 454064 [details] [diff] [review]
minor update to make patch apply properly

The output looks nice.


    Note that %diff is calculated using the fastest value (not avg) of all runs

                                     avm:0         avm2:0
    test                             best    avg   best    avg  %diff  sig
    Metric: v8 (largerValuesFaster)
    v8.5/untyped/raytrace.as         1802 1796.9   1788 1798.7    0.1  0.2   
    v8.5/untyped/deltablue.as        1000  990.2    986  995.0    0.3  0.3   

Is the comment about fastest vs avg still correct?  in the two examples above, best went down, avg went up, and %diff is positive.  Also might be good for the note to say "best" instead of "fastest".