Txul is not "Best nav open time of 9 runs", it's the median

NEW
Assigned to

Status

Webtools Graveyard
Tinderbox
10 years ago
4 years ago

People

(Reporter: (not reading, please use seth@sspitzer.org instead), Assigned: morgamic)

Tracking

Details

Txul is not "Best nav open time of 9 runs", it's the median

see 
http://lxr.mozilla.org/mozilla/source/xpfe/test/winopen.js#203

dump("__xulWinOpenTime:" + medOpenTime + "\n");

now see
http://lxr.mozilla.org/mozilla/source/tools/tinderbox/build-seamonkey-util.pl#2503

2503             $open_time = AliveTestReturnToken($test_name,
2504                                               $build_dir,
2505                                               [$binary, "-P", $Settings::MozProfileName, @urlargs],
2506                                               $Settings::XULWindowOpenTestTimeout,
2507                                               "__xulWinOpenTime",
2508                                               ":");

and see:

2514             print_log_test_result_ms('xulwinopen',
2515                                      'Best nav open time of 9 runs',
2516                                      $open_time, 'Txul');
2517 

so, should we be showing the min, or should we fix the text to be median?

see also http://wiki.mozilla.org/Performance:Tinderbox_Tests#Txul:_XUL_window_open_time

"10 windows are opened/closed and median and average times are printed."

note, we actually ignore the first time, and then determine the median,average,max,min of the following 9.
Product: Webtools → Webtools Graveyard
You need to log in before you can comment on or make changes to this bug.