309409 - NSS "perf" test script reports no output in results.html

Status: RESOLVED WONTFIX

(NSS :: Test, defect, P2)

Description

[Nelson Bolyard (seldom reads bugmail)]

The "all.sh" QA test script runs a script named "perf", located in
mozilla/security/nss/tests/perf/perf.sh
This script runs the rsaperf test prgram to measure how long it takes
to do 300 RSA private key operations.  
The script reports NO output in results.html file, where all the other
results from all.sh are summarized.  IMO, It should either contribute 
output to results.html, or be removed from all.sh.  
ideally it would actually detect a performance regression and report it.

Comment 1

[Julien Pierre]

In order to detect performance regressions, one would have to have a dedicated
machine running nothing but perf.sh, as well as old data to compare to. We have
neither at this time . Unless we can fix both issues, I think we should keep the
perf script, but it should not be called in all.sh . 

Comment 2

[Nelson Bolyard (seldom reads bugmail)]

Marking this P2 for 3.11.  That means we want it fixed in 3.11, but we wouldn't 
hold up the 3.11 release if it wasn't fixed.  This is assigned to Jason.

Comment 3

[Nelson Bolyard (seldom reads bugmail)]

Unsetting target milestone in unresolved bugs whose targets have passed.

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

The bug assignee is inactive on Bugzilla, and this bug has priority 'P2'.
:beurdouche, could you have a look please?

For more information, please visit auto_nag documentation.

Comment 5

[Anna Weine]

Attachment: Bug 309409 - Adding the perf test script