1138942 - Add Autophone specific video test manifest

Status: RESOLVED FIXED

(Testing :: Mochitest, defect)

Description

[Bob Clary [:bc] (inactive)]

Attachment: autophone-video

Autophone currently runs several mochitests via existing manifests in the tree:
https://wiki.mozilla.org/Auto-tools/Projects/AutoPhone/Autophone_for_developers#Tests

The intent is to test video and audio playback and the full sets of tests are not needed and actually take too long to execute on the available devices. This manifest is intended to provide a place for video tests to be added specifically for Autophone.

ted: I'm piggy backing on ahal's Makefile.in since we haven't removed it yet in favor of moz.build. Is this ok for now?

snorp: this is a preliminary patch with the tests you listed yesterday. Before I ask for a formal review, can we get a full list of tests? Perhaps you could invite some of the media folks to provide input on which tests we would like?

Comment 1

[James Willcox (:snorp) ([e-mail]) (he/him)]

Comment on attachment 8571958 [details]
autophone-video

I think 'autophone-media' is a better name for the file, but looks like a good start to me.

Anthony, can you or one of your folks let Bob know what we should put in here? The idea is for Autophone to only test the media bits that are significantly affected by hardware or OS differences.

Comment 2

[Anthony Jones (:ajones, :kentuckyfriedtakahe, :k17e)]

Video reftests would probably be the best approach. This will test our ability to decode video on each different piece of hardware. We need to add a reftest for MP4.

Comment 3

[Bob Clary [:bc] (inactive)]

Attachment: autophone-media.patch

works in local testing on autophone.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8588142 [details] [diff] [review]
autophone-media.patch

Review of attachment 8588142 [details] [diff] [review]:
-----------------------------------------------------------------

it would be cool if we could use the new tagging that :ahal is working on.  It might be a bit premature to do it, but that seems like the right longer term solution. maybe file a bug to do that.  The work was done in bug 987360.

Comment 5

[Bob Clary [:bc] (inactive)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/021f785c5e9b

I've also been testing using reftests for:

layout/reftests/ogg-video/reftest.list
layout/reftests/webm-video/reftest.list

Once the mochitest manifest merges, I'll run tests on treeherder staging and if all is well file a bug to get these on trychooser. Hopefully we can discontinue the old autophone mochitests early next week and turn these on.

Comment 6

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/mozilla-central/rev/021f785c5e9b