tests are in a list but test results are a dictionary

RESOLVED FIXED

Status

Testing
Talos
RESOLVED FIXED
6 years ago
6 years ago

People

(Reporter: Jeff Hammel, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

6 years ago
PerfConfigurator and the .yml files are perfect happy having multiple
tests of the same type, e.g.:

- cycles: 10
  name: ts
  shutdown: true
  timeout: 1050
  url: startup_test/startup_test.html
  url_timestamp: false
- cycles: 20
  name: ts
  shutdown: true
  timeout: 150
  url: startup_test/startup_test.html?begin=
  url_timestamp: true

However, we store the results in a dictionary based on test name

http://hg.mozilla.org/build/talos/file/170c100911b6/talos/run_tests.py#l582

This means that if you have more than one test for the same name you
will override the final results :(
(Reporter)

Comment 1

6 years ago
should be taken care of in https://bugzilla.mozilla.org/show_bug.cgi?id=755527
See Also: → bug 755527
(Reporter)

Comment 2

6 years ago
fixed with bug 755527
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.