1056526 - [MADAI][Multimedia] When starting video playback, Video frame was stopped for a moment.

Status: RESOLVED FIXED

(Core :: Audio/Video, defect, P2)

Description

[Jaemin Song]

User Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36

Steps to reproduce:

1. Playing attached video file.
2. When starting playback, Video frame is stopped for a moment.

When I operate seek function,
I can also find symptom that video frame is skipped.


Actual results:

As a result of debugging,
I have found "Skipping video decode to the next keyframe" log.
(When VideoQueue().GetSize() is 0, this log is detected.)
You can find this log in MediaDecoderStateMachine.cpp.
Please confirm this problem.

Thanks.

Comment 1

[Jaemin Song]

Because size of video file is big,
I can not attach video file.
But this issue is occurred using other A/V file.

If you need issue file, please let me know your email.
I'll send video file to email.

Thanks.

Comment 2

[bhavana bajaj [:bajaj]]

(In reply to Jaemin Song from comment #1)
> Because size of video file is big,
> I can not attach video file.
> But this issue is occurred using other A/V file.
> 
> If you need issue file, please let me know your email.
> I'll send video file to email.
> 
> Thanks.

can you please email the file to :[e-mail] so our QA can try and repro this.

Comment 3

[Jaemin Song]

(In reply to bhavana bajaj [:bajaj] from comment #2)
> can you please email the file to :[e-mail] so our QA can try and
> repro this.

I have sent video file through email.
Please confirm email.(My account is "[e-mail]")
If you play the clip using both PC and device,
you can find that video frame was skipped when using only FireFox device.

Thanks.

Comment 4

[Joshua Mitchell (Inactive)]

Qa-Wanted is not able to get a reliable repro because the video itself hitches (pauses) in multiple spots when viewing it on a computer - before even pushing it onto a device.

Comment 5

[Jaemin Song]

(In reply to Joshua Mitchell [:Joshua_M] from comment #4)
> Qa-Wanted is not able to get a reliable repro because the video itself
> hitches (pauses) in multiple spots when viewing it on a computer - before
> even pushing it onto a device.

If you can not confirm problem,
could you check this issue using other A/V file?
When you try to start playback
OR When you try to seek operation,
you can find that frame is skipped for a moment.
And when video is skipped, log is printed like below.
LOG: "Skipping video decode to the next keyframe"

Comment 6

[bhavana bajaj [:bajaj]]

(In reply to Jaemin Song from comment #5)
> (In reply to Joshua Mitchell [:Joshua_M] from comment #4)
> > Qa-Wanted is not able to get a reliable repro because the video itself
> > hitches (pauses) in multiple spots when viewing it on a computer - before
> > even pushing it onto a device.
> 
> If you can not confirm problem,
> could you check this issue using other A/V file?
> When you try to start playback
> OR When you try to seek operation,
> you can find that frame is skipped for a moment.
> And when video is skipped, log is printed like below.
> LOG: "Skipping video decode to the next keyframe"

jaemin, we have our QA doing daily testing and this issue is never reported.

Comment 7

[Jaemin Song]

(In reply to bhavana bajaj [:bajaj] from comment #6)
> jaemin, we have our QA doing daily testing and this issue is never reported.

Since video frame is skipped just once 
when starting playback Or operating seek function,
you will be hard to detect.
Could you check this issue after enable log in MediaDecoderStateMachine.cpp?
If you try to reproduce this issue,
you can find "Skipping video decode to the next keyframe" log.

Thanks.

Comment 8

[Blake Wu [:bwu][:blakewu]]

http://dxr.mozilla.org/mozilla-central/source/content/media/MediaDecoderStateMachine.cpp?from=MediaDecoderStateMachine.cpp&case=true#612
You can try to force skipToNextKeyFrame to be false to see if the problem is mitigated or not.

Comment 9

[StevenLee[:slee]]

I downloaded a webm file from http://video.webmfiles.org/big-buck-bunny_trailer.webm. Try it on my flame with 2.1 code base. I cannot reproduce this problem and I don't get the "Skipping video decode to the next keyframe" log. From comment 4, it seems that the file itself has problems. Jaemin, can you try other files? If you cannot reproduce it with other files, I think it should not be a blocker.

Comment 10

[Jaemin Song]

(In reply to StevenLee[:slee] from comment #9)
> I downloaded a webm file from
> http://video.webmfiles.org/big-buck-bunny_trailer.webm. Try it on my flame
> with 2.1 code base. I cannot reproduce this problem and I don't get the
> "Skipping video decode to the next keyframe" log. From comment 4, it seems
> that the file itself has problems. Jaemin, can you try other files? If you
> cannot reproduce it with other files, I think it should not be a blocker.

I have downloaded a webm file from http://video.webmfiles.org/big-buck-bunny_trailer.webm.
When I try to reproduce issue with above link file,
issue is occurred on my device(Madai) and I can find "Skipping video decode to the next keyframe" log.
Could you check this issue again using FireFox OS 2.0 version?

Thanks.

Comment 11

[Jaemin Song]

(In reply to Blake Wu [:bwu][:blakewu] from comment #8)
> http://dxr.mozilla.org/mozilla-central/source/content/media/
> MediaDecoderStateMachine.cpp?from=MediaDecoderStateMachine.cpp&case=true#612
> You can try to force skipToNextKeyFrame to be false to see if the problem is
> mitigated or not.

After changing to false, problem is not mitigated.
Problem is still occurred.

Thanks.

Comment 12

[StevenLee[:slee]]

Hi Jaemin,

I updated the latest 2.0 code. It works fine and I cannot find the log.

Comment 13

[Jaemin Song]

(In reply to StevenLee[:slee] from comment #12)
> Hi Jaemin,
> 
> I updated the latest 2.0 code. It works fine and I cannot find the log.

I don't know why result is different.
Do you have a *Madai* device(v2.0)??
If you have *Madai* device, please confirm this case using *Madai* device.

(* Additional info: When I reproduce this issue using Video only file,
issue is not occurred.)

Thanks.

Comment 14

[StevenLee[:slee]]

(In reply to Jaemin Song from comment #13)
> I don't know why result is different.
> Do you have a *Madai* device(v2.0)??
> If you have *Madai* device, please confirm this case using *Madai* device.
> 
> (* Additional info: When I reproduce this issue using Video only file,
> issue is not occurred.)
> 
> Thanks.
I have no Madai device in hand. What I did was trying to reproduce the problem on Flame. BTW, when I load the webm, [1], from broser, I still don't have such problem.

[1] http://video.webmfiles.org/big-buck-bunny_trailer.webm

Comment 15

[Jaemin Song]

Dear Blake,

Could you check this issue on *Madai* device?
Please check whether problem is occurred on *Madai* device.

Thanks.

Comment 16

[Wayne Chang [:wchang]]

Jaemin,

Please confirm problem is seen on Flame first. 2.0- for now.

Your team has some Flame devices, please borrow one from them.

Comment 17

[Jaemin Song]

(In reply to Wayne Chang [:wchang] from comment #16)
> Jaemin,
> 
> Please confirm problem is seen on Flame first. 2.0- for now.
> 
> Your team has some Flame devices, please borrow one from them.

OK, I'll borrow Flame devices and confirm it.

Thanks.

Comment 18

[Jaemin Song]

I have checked this issue on Flame device.
Issue was reproduced on Flame device.
When I seek the video file,
video was stopped for a moment.

But I can not confirm log.
How can I enable PR_LOG in Flame device?

Thanks.

Comment 19

[Jaemin Song]

Default setting of LOG status is "disabled" on Flame device.
So, I can not confirm MediaDecoderStateMachine Logs.
Could you let me know how can enable PR_LOG?

Thanks.

Comment 20

[StevenLee[:slee]]

Hi Jaemin,

For enabling PR_LOG, you have to
1. build debug version gecko
2. stop b2g and set environment variable on device, NSPR_LOG_MODULES=MediaDecoder:5, [1].
3. start b2g

[1] http://dxr.mozilla.org/mozilla-central/source/nsprpub/pr/include/prlog.h#43

Comment 21

[Jaemin Song]

I have enabled log and checked problem on Flame.(v2.0)
As a result of test,
I could reproduce issue and
found "Skipping video decode to the next keyframe" log.
To confirm the log, I had added log using "android/log.h".

Please confirm problem again.
Thanks.

Comment 22

[Benjamin Chen [:bechen]]

Hi JW:
Please provide the bug number that fix the "backward" audio timestamp on StateMachine.
I want to try that patch first.

Comment 23

[JW Wang [:jwwang] [:jw_wang]]

Bug 1057199 comment 1.

Comment 24

[Benjamin Chen [:bechen]]

Hi Jaemin:
I have test the patch in Bug 1057199, without that fix, I can see the log "Skipping video decode to the next keyframe" at the beginning of playback. After apply that fix, I don't see the log.

Please try that patch, if it works, we can uplift it to 2.0.
thanks

Comment 25

[Jaemin Song]

(In reply to Benjamin Chen [:bechen] from comment #24)
> Hi Jaemin:
> I have test the patch in Bug 1057199, without that fix, I can see the log
> "Skipping video decode to the next keyframe" at the beginning of playback.
> After apply that fix, I don't see the log.
> 
> Please try that patch, if it works, we can uplift it to 2.0.
> thanks

I have applied patch in Bug 1057199.
After applying this patch,
problem was not occurred and video frame is not skipped.
Issue is fixed.
Please uplift this patch to 2.0.

Thanks.

Comment 26

[Rachelle Yang [:ryang][[e-mail]]]

Triage to set it to 2.0+.

Comment 27

[StevenLee[:slee]]

The patch was landed in bug 1057199.

Comment 28

[Coler]

This issue has been verified successfully on Woodduck 2.0;Flame2.0&2.1.
Reproducing rate: 0/5
See attachment: Verify_Woodduck_VideoFrame.mp4

Woodduck build version:
Gaia-Rev        87b23fa81c3b59f2ba24b84f7d686f4160d4e7cb
Gecko-Rev       d049d4ef127844121c9cf14d2e8ca91fd9045fcb
Build-ID        20141125050313
Version         32.0

Flame2.0 build:
Gaia-Rev        124c2f85f1b956e9e8429dab5121de702a3bc197
Gecko-Rev       https://hg.mozilla.org/releases/mozilla-b2g32_v2_0/rev/fc90ac008cc1
Build-ID        20141124000201
Version         32.0

Flame2.1 build:
Gaia-Rev        8ae086c39011bc8842b2a19bb5267906fa22345a
Gecko-Rev       https://hg.mozilla.org/releases/mozilla-b2g34_v2_1/rev/ebbd5c65c3c1
Build-ID        20141124094013
Version         34.0

Comment 29

[Coler]

Attachment: Verfiy_Woodduck_VideoFrame.MP4