767227 - Create Talos test for Kraken

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[David Mandelin [:dmandelin]]

The Kraken benchmarks use the SunSpider harness, so it's pretty much the same thing on a different URL:

  http://krakenbenchmark.mozilla.org/kraken-1.1/driver.html

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Right now kraken reports a series of numbers and takes the mean of those numbers to report for each page/test.  At the end the reported number is a sum of the means.

This works sort of good with our existing infrastructure except for the sum part at the end.  Currently we can send a list of pages and their reported value (mean) to graph server, but graph server will report an average of those numbers (after dropping the highest value).  

Is it critical to report on graph server as we do from the kraken test?

Comment 2

[Jeff Hammel]

adding Christina for any metrics input

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

landed in the talos repo:
http://hg.mozilla.org/build/talos/rev/807c94aef671

we still need to resolve reporting, etc...