1503952 - Tests using MP4 video in MediaElementTest fail on Android

Status: RESOLVED WONTFIX

(Core :: Audio/Video, enhancement, P2)

Description

[Randall Barker [:rbarker]]

The tests that use an MP4 video in MediaElementTest.kt fail in automation. The same test pass when run locally on device as well as on x86 and arm emulators.

Comment 1

[Chris Peterson [:cpeterson]]

Nils, is there a media engineer who can help debug this Android media test failure?

The mp4 test passes locally but fails in automation. The ogg and webm tests pass locally and in automation.

Comment 2

[Chris Peterson [:cpeterson]]

Sending this bug to the A/V component

Comment 3

[Chris Peterson [:cpeterson]]

(In reply to Randall Barker [:rbarker] from comment #0)

The tests that use an MP4 video in MediaElementTest.kt fail in automation.
The same test pass when run locally on device as well as on x86 and arm
emulators.

James, you mentioned yesterday that media playback tests don't work well in Android emulators due to issues with the emulator's software decoders. Should we just WONTFIX this MP4 test failure for MediaElementTest.kt?

We currently run the mochitest-mda (dom/media) tests on Bitbar's Moto G5 and Pixel 2 devices. Should we move this MediaElementTest.kt test from the emulators to those real devices?

Comment 4

[James Willcox (:snorp) ([e-mail]) (he/him)]

We can probably close this, but yeah we should consider running this MediaElement test on real hardware in addition to the emulators.

Comment 5

[Chris Peterson [:cpeterson]]

I asked Matt if we could run these tests on Bitbar's real Pixel 2 devices. He said the full geckoview-junit test suite takes 40-50 minutes in the x86 and ARM emulators, so running the full suite on a Pixel 2 is not practical.

I'll close this MP4 test bug. We do run mda media tests on the Pixel 2 and MediaElementTest.kt still tests webm and ogg on the emulators, so we have some test coverage.