399675 - Txul is not "Best nav open time of 9 runs", it's the median

Status: RESOLVED WONTFIX

(Webtools Graveyard :: Tinderbox, defect)

Description

[(not reading, please use [e-mail] instead)]

Txul is not "Best nav open time of 9 runs", it's the median

see 
http://lxr.mozilla.org/mozilla/source/xpfe/test/winopen.js#203

dump("__xulWinOpenTime:" + medOpenTime + "\n");

now see
http://lxr.mozilla.org/mozilla/source/tools/tinderbox/build-seamonkey-util.pl#2503

2503             $open_time = AliveTestReturnToken($test_name,
2504                                               $build_dir,
2505                                               [$binary, "-P", $Settings::MozProfileName, @urlargs],
2506                                               $Settings::XULWindowOpenTestTimeout,
2507                                               "__xulWinOpenTime",
2508                                               ":");

and see:

2514             print_log_test_result_ms('xulwinopen',
2515                                      'Best nav open time of 9 runs',
2516                                      $open_time, 'Txul');
2517 

so, should we be showing the min, or should we fix the text to be median?

see also http://wiki.mozilla.org/Performance:Tinderbox_Tests#Txul:_XUL_window_open_time

"10 windows are opened/closed and median and average times are printed."

note, we actually ignore the first time, and then determine the median,average,max,min of the following 9.

Comment 1

[Sylvestre Ledru [:Sylvestre]]

Tinderbox isn't maintained anymore. Closing.