942490 - [integraion-test] The media_playback_test test is failed in local and Travis.

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::System, defect)

Description

[Evan Tseng [:evanxd]]

Hi all,

The media_playback_test test is failed in local and Travis.
You could run the test with "./bin/gaia-marionette ./apps/system/test/marionette/media_playback_test.js", then you will see the below message. 

13 passing (1 minutes)
  1 failing

  1) media playback tests in utility tray should play/pause from now playing widget after closing and reopening music app:
     
  ElementNotVisible: (11) Element is not visible
  Remote Stack:
  <none>
      at Error.MarionetteError (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/error.js:67:13)
      at Object.Client._handleCallback (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/client.js:474:19)
      at /Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/client.js:508:21
      at TcpSync.send (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:94:10)
      at Object.send (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/client.js:455:36)
      at Object.Client._sendCommand (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/client.js:501:19)
      at Object.Element._sendCommand (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/element.js:49:21)
      at Object.click (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/marionette-client/lib/marionette/element.js:172:19)
      at click (/Users/itoyxd/evan/dev/mozilla/gaia/apps/system/test/marionette/lib/media_playback.js:12:11)
      at Object.MediaPlaybackContainer.playPause (/Users/itoyxd/evan/dev/mozilla/gaia/apps/system/test/marionette/lib/media_playback.js:101:5)
      at /Users/itoyxd/evan/dev/mozilla/gaia/apps/system/test/marionette/media_playback_test.js:153:21
      at Object.MediaPlayback.inUtilityTray (/Users/itoyxd/evan/dev/mozilla/gaia/apps/system/test/marionette/lib/media_playback.js:158:5)
      at Context.<anonymous> (/Users/itoyxd/evan/dev/mozilla/gaia/apps/system/test/marionette/media_playback_test.js:151:35)
      at Test.Runnable.run (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runnable.js:211:32)
      at Runner.runTest (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:355:10)
      at /Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:401:12
      at next (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:281:14)
      at /Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:290:7
      at next (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:234:23)
      at Object._onImmediate (/Users/itoyxd/evan/dev/mozilla/gaia/node_modules/mocha/lib/runner.js:258:5)
      at processImmediate [as _immediateCallback] (timers.js:330:15)

Comment 1

[Evan Tseng [:evanxd]]

In Travis, currently you could see errors in many PRs. For example, https://travis-ci.org/mozilla-b2g/gaia/jobs/14422659#L1059.

Comment 2

[Evan Tseng [:evanxd]]

Attachment: PR for disabling the test

Comment 3

[Evan Tseng [:evanxd]]

We could disable the test first, then we could continue to figure out this issue.
And we already had a patch for disabling the test.

Comment 4

[Jim Porter (:squib)]

Are you sure something's not broken on Travis? That test passes for me locally.

Comment 5

[Jim Porter (:squib)]

Yeah, let's disable this test for now, but keep this bug open to figure out how to fix the test?

Comment 6

[Kevin Grandon :kgrandon]

Bug 936201 was re-landed which is may trigger this a lot on travis. Let's land this soon please. :)

Comment 7

[Anthony Ricaud (:rik)]

Comment on attachment 8337645 [details]
PR for disabling the test

Merged in https://github.com/mozilla-b2g/gaia/commit/441e70921b70ba02d355d7ecaadc780e11448043. Thanks for this skip.

Comment 8

[Anthony Ricaud (:rik)]

Jim: I'm gonna assign this bug to you just to be sure we have someone responsible for re-enabling this. Feel free to pass it to someone else if it makes sense.

Comment 9

[Jim Porter (:squib)]

Gareth: This is the issue I was talking about on IRC. If you could take a look at it and see what's up, that'd be cool. Feel free to take the bug for yourself if you like!

Comment 10

[Evan Tseng [:evanxd]]

(In reply to Jim Porter (:squib) from comment #4)
> Are you sure something's not broken on Travis? That test passes for me
> locally.

Hi Jim,

Excuse me.
But I don't know why the test cannot be passed in my local.
It is weird.

Comment 11

[Jim Porter (:squib)]

(In reply to Evan Tseng [:evanxd] from comment #10)
> Hi Jim,
> 
> Excuse me.
> But I don't know why the test cannot be passed in my local.
> It is weird.

The failure is random, and after running it a few times I got some failures, but notably, the failures are different from the one posted in this bug.

Comment 12

[Jim Porter (:squib)]

Anyway, I'll talk to Gareth about this and hopefully we can fix it.

Comment 13

[Evan Tseng [:evanxd]]

Hi Jim,

I also could help for Marionette things.
If you have questions for it, we could discuss that here. :)

Comment 14

[Etienne Segonzac (:etienne)]

Not more skipped media_playback test since bug 1057198, marking this resolved.

Comment 15

[Jim Porter (:squib)]

This is fixed, clearning needinfo.