Open Bug 562747 Opened 14 years ago Updated 2 years ago

There should be a better way to mark tests as "slow" in jstests.list

Categories

(Testing :: Reftest, defect)

Product:
Testing
Component:
Reftest
Platform:
x86
macOS
Type:
defect

Tracking

(Not tracked)

People

(Reporter: jruderman, Unassigned)

Details

Our jstests.list files are full of entries like:
  skip script regress-345967.js # slow

This means the tests never run at all.  There should be a way to explicitly include slow tests, so we can at least run them occasionally.  Maybe something like:
  skip-if(!includeSlowTests) script regress-345967.js
It would be trivial to make this something you could flip by modifying reftest.js and rebuilding, which might well be sufficient.
manifest.py can now recognize a "slow" annotation, and jstests.py has a --run-slow-tests option. Perhaps more of the "# slow" tests should have the "slow" part moved to somewhere the manifest parser can see it (i.e. before the start of the comment)? I'd be happy to move on this.
Is this still something we care to do?
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.