Note: There are a few cases of duplicates in user autocompletion which are being worked on.

talos runs tests in a different order than listed in the config file

RESOLVED FIXED

Status

Release Engineering
General
--
minor
RESOLVED FIXED
10 years ago
4 years ago

People

(Reporter: bhearsum, Assigned: alice)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(1 attachment)

(Reporter)

Description

10 years ago
Talos seems to run tests in a random order. I would expected that they be run in the same order listed in the config file. Not a big deal, but unintuitive.
(Assignee)

Updated

9 years ago
Component: Testing → Release Engineering: Future
Product: Core → mozilla.org
QA Contact: testing → release
Version: Other Branch → other
(Assignee)

Comment 1

9 years ago
This has to do with how the yaml file is formatted - will get fixed up as I'm working on the structure of how talos gets configured.
Assignee: nobody → anodelman
(Assignee)

Comment 2

9 years ago
Created attachment 342672 [details] [diff] [review]
[Checked in]run the tests in the order that they appear in the config file

It's a minor nuisance, but I think that it is worth the effort - especially if we go to a system where we report test results after each test has run, we'll want to put them in an order of speed so that developers can get quick results for ts/twinopen/etc and then run tp.
Attachment #342672 - Flags: review?(bhearsum)
(Reporter)

Updated

9 years ago
Attachment #342672 - Flags: review?(bhearsum) → review+
(Reporter)

Comment 3

9 years ago
Comment on attachment 342672 [details] [diff] [review]
[Checked in]run the tests in the order that they appear in the config file

YAML format is weird...but this looks fine.
(Assignee)

Comment 4

9 years ago
Comment on attachment 342672 [details] [diff] [review]
[Checked in]run the tests in the order that they appear in the config file

Checking in sample.config;
/cvsroot/mozilla/testing/performance/talos/sample.config,v  <--  sample.config
new revision: 1.19; previous revision: 1.18
done
Checking in run_tests.py;
/cvsroot/mozilla/testing/performance/talos/run_tests.py,v  <--  run_tests.py
new revision: 1.31; previous revision: 1.30
done
Checking in PerfConfigurator.py;
/cvsroot/mozilla/testing/performance/talos/PerfConfigurator.py,v  <--  PerfConfigurator.py
new revision: 1.6; previous revision: 1.5
done
Attachment #342672 - Attachment description: run the tests in the order that they appear in the config file → [Checked in]run the tests in the order that they appear in the config file
(Assignee)

Comment 5

9 years ago
Reported numbers look good - the patch shouldn't have affected anything but it is always good to be careful.
Status: NEW → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED

Comment 6

8 years ago
Moving closed Future bugs into Release Engineering in preparation for removing the Future component.
Component: Release Engineering: Future → Release Engineering
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.