Last Comment Bug 655622 - Add SpecialPowers for reftests to use
: Add SpecialPowers for reftests to use
Status: NEW
:
Product: Testing
Classification: Components
Component: Reftest (show other bugs)
: unspecified
: All All
: -- normal (vote)
: ---
Assigned To: Nobody; OK to take it and work on it
:
Mentors:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2011-05-08 14:38 PDT by Jonathan Watt [:jwatt] (Away Jun. 27 - Jul. 13)
Modified: 2015-05-06 17:43 PDT (History)
7 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---


Attachments

Description Jonathan Watt [:jwatt] (Away Jun. 27 - Jul. 13) 2011-05-08 14:38:16 PDT
We should consider adding SpecialPowers to reftests. See bug 612214 comment 134.
Comment 1 David Baron :dbaron: ⌚️UTC-7 (review requests must explain patch) 2011-05-08 16:53:45 PDT
My inclination has always been not to do this, because I want reftests to be largely something that can be used across browsers.
Comment 2 Ted Mielczarek [:ted.mielczarek] 2011-05-09 04:49:05 PDT
I understand that, but currently that means that anything that wants privileges but a reftest-style test winds up as a chrome mochitest, which is not a great fit for reftest-style testing. It also means that the tests wind up not being usable across browsers anyway.

Would you feel better if we added a reftest manifest flag to enable it on a test-by-test basis? Or if we split these tests off into another set of manifests and called them "chrome reftests" or something like that? (We could do that and have the entire set of tests be loaded from chrome:// URLs, obviating the need for SpecialPowers.)
Comment 3 Jonathan Watt [:jwatt] (Away Jun. 27 - Jul. 13) 2011-05-09 05:10:19 PDT
FWIW I talked to the Opera and IE guys on the SVG WG and they were for standardizing something like SpecialPowers so that we could share tests that need to do things that normal content can't. They even seemed positive about adding a pref or command line arg to turn it on in release builds (on a per domain basis) so that third parties could write/run tests and have transparency into the results in their respective implementations.
Comment 4 David Baron :dbaron: ⌚️UTC-7 (review requests must explain patch) 2011-05-09 08:53:28 PDT
I'd be a lot more comfortable with a limited set of special powers custom-designed for reftest (and which other browsers agree should be exposed) than with the large set we expose to mochitests.

(In reply to comment #2)
> I understand that, but currently that means that anything that wants
> privileges but a reftest-style test winds up as a chrome mochitest, which is
> not a great fit for reftest-style testing.

I think saying "anything" here is too strong.  Some of the time, test authors realize that they don't actually need the special privilege to write the test, and they write the test another way.  My point is to encourage that.

Note You need to log in before you can comment on or make changes to this bug.