1548446 - Intermittent dom/media/test/test_webvtt_seeking.html | Test timed out.

Status: RESOLVED INCOMPLETE

(Core :: Audio/Video: Playback, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: aiakab [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=244075211&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/ExYcZRfjSDylMR91RgX8MA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/ExYcZRfjSDylMR91RgX8MA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-05-02T02:15:21.040Z] 02:15:21 INFO - 28 INFO TEST-START | dom/media/test/test_webvtt_seeking.html
[task 2019-05-02T02:20:20.639Z] 02:20:20 INFO - Buffered messages logged at 02:15:22
[task 2019-05-02T02:20:20.639Z] 02:20:20 INFO - 29 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | A valid string reason is expected
[task 2019-05-02T02:20:20.640Z] 02:20:20 INFO - 30 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | Reason cannot be empty
[task 2019-05-02T02:20:20.640Z] 02:20:20 INFO - Buffered messages logged at 02:15:23
[task 2019-05-02T02:20:20.640Z] 02:20:20 INFO - 31 INFO start play video
[task 2019-05-02T02:20:20.640Z] 02:20:20 INFO - Buffered messages logged at 02:15:27
[task 2019-05-02T02:20:20.642Z] 02:20:20 INFO - 32 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | video has started playing
[task 2019-05-02T02:20:20.642Z] 02:20:20 INFO - 33 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | seek target time 1 is within the correct range
[task 2019-05-02T02:20:20.642Z] 02:20:20 INFO - Buffered messages logged at 02:15:28
[task 2019-05-02T02:20:20.642Z] 02:20:20 INFO - 34 INFO seek video to 1
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - Buffered messages logged at 02:15:30
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - 35 INFO cue 0 is showing
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - 36 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | cue 0 [1:3] is active
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - Buffered messages logged at 02:15:31
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - 37 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | cue 1 [4:6] is inactive
[task 2019-05-02T02:20:20.643Z] 02:20:20 INFO - 38 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | seek target time 4 is within the correct range
[task 2019-05-02T02:20:20.644Z] 02:20:20 INFO - 39 INFO seek video to 4
[task 2019-05-02T02:20:20.644Z] 02:20:20 INFO - Buffered messages logged at 02:15:41
[task 2019-05-02T02:20:20.645Z] 02:20:20 INFO - 40 INFO cue 1 is showing
[task 2019-05-02T02:20:20.645Z] 02:20:20 INFO - Buffered messages logged at 02:15:42
[task 2019-05-02T02:20:20.645Z] 02:20:20 INFO - 41 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | cue 1 [4:6] is active
[task 2019-05-02T02:20:20.645Z] 02:20:20 INFO - 42 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | cue 0 [1:3] is inactive
[task 2019-05-02T02:20:20.646Z] 02:20:20 INFO - 43 INFO TEST-PASS | dom/media/test/test_webvtt_seeking.html | seek target time 1 is within the correct range
[task 2019-05-02T02:20:20.646Z] 02:20:20 INFO - 44 INFO seek video to 1
[task 2019-05-02T02:20:20.646Z] 02:20:20 INFO - Buffered messages finished
[task 2019-05-02T02:20:20.647Z] 02:20:20 INFO - 45 INFO TEST-UNEXPECTED-FAIL | dom/media/test/test_webvtt_seeking.html | Test timed out.
[task 2019-05-02T02:20:20.647Z] 02:20:20 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:18
[task 2019-05-02T02:20:20.648Z] 02:20:20 INFO - reportError@SimpleTest/TestRunner.js:121:22
[task 2019-05-02T02:20:20.648Z] 02:20:20 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2019-05-02T02:20:21.358Z] 02:20:21 INFO - 46 INFO TEST-OK | dom/media/test/test_webvtt_seeking.html | took 301204ms
[task 2019-05-02T02:20:23.587Z] 02:20:23 INFO - 47 INFO TEST-START | Shutdown

Comment 1

[Intermittent Failures Robot]

20 failures in 807 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-inbound: 5
• try: 2
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-03&endday=2019-05-03&tree=all

Comment 2

[Intermittent Failures Robot]

24 failures in 4131 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 15
• mozilla-inbound: 5
• try: 2
• mozilla-central: 2

Platform breakdown:

• android-em-4-3-armv7-api16: 1
• android-hw-p2-8-0-arm7-api-16: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 3

[Andreea Pavel [:apavel]]

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C8.0%2Cpixel2%2Copt%2Cmochitests%2Cwithout%2Ce10s%2Ctest-android-hw-p2-8-0-arm7-api-16%2Fopt-mochitest-media-1proc-1%2Cm-1proc%28mda1%29&tochange=2996e082682ca6418ea92337eb2d12b6b86fd95b&fromchange=cd4a75c0bee4b6827bb41fcd7695a35297aa8da8&selectedJob=245280147

Michael can you take a look?

Comment 4

[Intermittent Failures Robot]

21 failures in 952 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 2
• mozilla-inbound: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-08&endday=2019-05-08&tree=all

Comment 5

[Michael Froman [:mjf]]

Strange, since 1548858 was backed out. I'll take a look.

Comment 6

[Michael Froman [:mjf]]

After looking at when Bug 1548858 first landed, this could not be caused by 1548858. This bug was reported 8 days ago, and 1548858 first landed 2 days ago.

Comment 7

[Intermittent Failures Robot]

29 failures in 821 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 3
• mozilla-inbound: 4
• try: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-09&endday=2019-05-09&tree=all

Comment 8

[Andreea Pavel [:apavel]]

Thanks Michael for narrowing it down.

Alastor can you please take a look? the failure first appeared in TV when Bug 1535005 landed here:

https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=f188012d248d72153c9a5068b38ba247dac4deb9&selectedJob=244075211

Comment 9

[Intermittent Failures Robot]

28 failures in 852 pushes (0.033 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-inbound: 7
• try: 3
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 28

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-10&endday=2019-05-10&tree=all

Comment 10

[Intermittent Failures Robot]

111 failures in 4705 pushes (0.024 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 77
• mozilla-inbound: 16
• mozilla-central: 11
• try: 7

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 111

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 11

[Alastor Wu [:alwu]]

I'm going to add more log in test for diagnosing to see which event causes timeout problem (seeked or enter event).

Comment 12

[Alastor Wu [:alwu]]

Attachment: Bug 1548446 - part1 : add more debug log in 'test_webvtt_seeking.html'.

Add more log in order to help debug and know where we get failure.

Comment 13

[Alastor Wu [:alwu]]

Attachment: Bug 1548446 - part2 : should wait until seek completed.

Main test function should await seekVideo() until it finishes.

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/42f2738786c9
part1 : add more debug log in 'test_webvtt_seeking.html'. r=jolin
https://hg.mozilla.org/integration/autoland/rev/770dba43cd13
part2 : should wait until seek completed. r=jolin

Comment 15

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/42f2738786c9
https://hg.mozilla.org/mozilla-central/rev/770dba43cd13

Comment 16

[Intermittent Failures Robot]

24 failures in 746 pushes (0.032 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 15
• mozilla-central: 2
• mozilla-inbound: 4
• try: 3

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 22
• android-em-4-3-armv7-api16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-13&endday=2019-05-13&tree=all

Comment 17

[Alastor Wu [:alwu]]

After checking the log I pushed yesterday, there are two different kinds of error.

(1) Seek failed
Before and after seeking, we will print the log to show if seeking is successful. However, on Android 8.0 pixel2, only the log before seeking was printed, there is no log after seeking [1].

INFO - 543 INFO seek video to 1

It means that seeking failed so we couldn't get the seeked event. [2]

[1]
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=246400504&repo=autoland&lineNumber=3624
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=246298944&repo=mozilla-central&lineNumber=3631

[2] https://searchfox.org/mozilla-central/rev/116bd975c30746ddefc3d20e6947d1871469354f/dom/media/test/test_webvtt_seeking.html#101-102

(2) Seek succeeded, but wrong place
It happens on Android 4.3, seeking succeeded but seek to the wrong place [3].

INFO seek video to 1
INFO seek succeeded, current time=4.863999

As the current time is incorrect, we can't show the correct cue so that we got the timeout because the cue won't be showed [4].

[3]
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=246302501&repo=mozilla-inbound&lineNumber=1542
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=246322554&repo=mozilla-inbound&lineNumber=1531

[4] https://searchfox.org/mozilla-central/rev/116bd975c30746ddefc3d20e6947d1871469354f/dom/media/test/test_webvtt_seeking.html#89-92

Comment 18

[Alastor Wu [:alwu]]

Hi, John,
Per comment17, do you have any idea about this seeking problem?
Thank you.

Comment 19

[Intermittent Failures Robot]

33 failures in 962 pushes (0.034 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 13
• mozilla-inbound: 9
• mozilla-central: 8
• try: 2
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 29
• android-em-4-3-armv7-api16: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-14&endday=2019-05-14&tree=all

Comment 20

[Intermittent Failures Robot]

22 failures in 907 pushes (0.024 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 14
• mozilla-inbound: 4
• mozilla-central: 3
• try: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-15&endday=2019-05-15&tree=all

Comment 21

[Alastor Wu [:alwu]]

Attachment: Bug 1548446 - disable 'test_webvtt_seeking.html' on Android

According to the comment [1], there are some seeking issue on Android which causes the intermittent failure, so we are going to disable this test on Android.

[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1548446#c17

Comment 22

[Intermittent Failures Robot]

43 failures in 887 pushes (0.048 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 24
• mozilla-inbound: 9
• mozilla-central: 3
• try: 4
• mozilla-beta: 3

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 43

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-16&endday=2019-05-16&tree=all

Comment 23

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/573f03a88ea9
disable 'test_webvtt_seeking.html' on Android r=jolin

Comment 24

[Jean-Yves Avenard [:jya]]

Please open a bug, or link to an existing bug to work on why that test is failing on android. Thank you.

Comment 25

[Alastor Wu [:alwu]]

Filed bug1552607.

Comment 26

[Intermittent Failures Robot]

24 failures in 856 pushes (0.028 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• try: 1
• mozilla-inbound: 7
• autoland: 12
• mozilla-central: 4

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-17&endday=2019-05-17&tree=all

Comment 27

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/573f03a88ea9

Comment 28

[Intermittent Failures Robot]

148 failures in 4658 pushes (0.032 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 78
• mozilla-inbound: 33
• try: 12
• mozilla-central: 20
• mozilla-beta: 5

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 142
• android-em-4-3-armv7-api16: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 29

[Intermittent Failures Robot]

4 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 4

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 30

[Intermittent Failures Robot]

3 failures in 4337 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 31

[Alastor Wu [:alwu]]

Should re-enable this test after fixing bug 1552607, add NI.

Comment 32

[Intermittent Failures Robot]

1 failures in 3964 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 4314 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 5483 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 4955 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 36

[Alastor Wu [:alwu]]

We've enabled this test on Android.

Comment 37

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 38

[Dorel Luca [:dluca]]

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=300062787&repo=autoland&lineNumber=2790

Comment 39

[Intermittent Failures Robot]

1 failures in 5423 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 5276 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 4727 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1548446&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 42

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 43

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer?job_id=322953907&repo=autoland&lineNumber=2875

Comment 44

[Intermittent Failures Robot]

1 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1548446&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 45

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 46

[Atila Butkovits]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=339915380&repo=autoland&lineNumber=2243

Comment 47

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1548446&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 48

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.