Last Comment Bug 696295 - Tracking: Add qemu tests for hardware APIs once the harness is ready
: Tracking: Add qemu tests for hardware APIs once the harness is ready
Status: RESOLVED WORKSFORME
:
Product: Core
Classification: Components
Component: DOM (show other bugs)
: unspecified
: ARM Android
: -- normal (vote)
: ---
Assigned To: Nobody; OK to take it and work on it
:
: Andrew Overholt [:overholt]
Mentors:
Depends on: 702671
Blocks:
  Show dependency treegraph
 
Reported: 2011-10-20 18:38 PDT by Chris Jones [:cjones] inactive; ni?/f?/r? if you need me
Modified: 2013-02-25 14:20 PST (History)
17 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---
-


Attachments

Description Chris Jones [:cjones] inactive; ni?/f?/r? if you need me 2011-10-20 18:38:21 PDT
We need to land some new DOM APIs that we can't test properly and automatically without better harness support.  Those will land with Litmus and basic API tests, but once the harness support is there, we need to add comprehensive functional tests.  Tracking them here so that we don't forget.
Comment 1 cmtalbert 2011-10-24 21:20:32 PDT
Is there someplace I can look to see what it is in mind that you need for better harness support?  We are currently building some harness support for b2g, which is the ultimate consumer of these APIs and so I want to be sure that we're planning and thinking about the right things.
Comment 2 Chris Jones [:cjones] inactive; ni?/f?/r? if you need me 2011-10-24 21:30:10 PDT
The most that's been written up is [1].  Briefly, we want to launch qemu instances, manipulate them using something like the console interface [2], and also check for specific output that might be spewed from something like the console.

Running tests within qemu instances should work the same as running them using adb on real devices, since adb knows about running android-qemu instances.  We'll want to launch multiple instances to test APIs like SMS and telephony, which may require new code.  We'll need some new code in the harnesses to frob the virtual devices.  We'll also need some new code in qemu to support virtual devices better.  The good news is that qemu runs on desktops (obviously) so it's a lot easier to hack on.

What's the best place for us to discuss this work?  Here ok?

[1] http://groups.google.com/group/mozilla.dev.webapi/browse_thread/thread/dae263e27197f9a0#
[2] http://developer.android.com/guide/developing/devices/emulator.html#console
Comment 3 Chris Jones [:cjones] inactive; ni?/f?/r? if you need me 2011-10-24 21:33:55 PDT
Oh, and I forgot to add: running in the harness the code shown as

     <!-- Runs in test driver -->
     <script type="application/python">

in the example will obviously also require new harness code.
Comment 4 Chris Jones [:cjones] inactive; ni?/f?/r? if you need me 2011-10-24 21:38:21 PDT
One more thing: we'll want to use all this new harness code for Firefox/Android too, to test the APIs we're able to add there.  We won't be able to run the "receive call" tests, e.g., because we can't implement that feature on android.
Comment 5 Dietrich Ayala (:dietrich) 2012-05-31 20:40:17 PDT
Not actually blocking each of those APIs (some of which have landed). Having a testing tracker bug muddies the water. If there are specific features that need tests that we can't ship without, file individual bugs for those.
Comment 6 Chris Jones [:cjones] inactive; ni?/f?/r? if you need me 2013-02-25 14:20:52 PST
We are indeed adding these tests.

Note You need to log in before you can comment on or make changes to this bug.