1344632 - Intermittent AssertionError: Timed out after 60.1 seconds with message: Check if video has played some range

Status: RESOLVED INCOMPLETE

(Testing Graveyard :: external-media-tests, defect)

Description

[Treeherder Bug Filer]

Filed by: cbook [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=81661964&repo=mozilla-central

https://queue.taskcluster.net/v1/task/QrM9fkcnTf6R_tj5XPj7EQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Ryan VanderMeulen [:RyanVM]]

Bryce, there seem to be a lot of VP failures lately across the trees. Did something change on Youtube's end or something?

Comment 2

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

There's an issue with the performance of the twitch tests on debug builds. These should be disabled now by 1343999. These tests will have been failing for awhile, but due to a bug with return codes not being set, it's only recently that the failures have started to be reported: 1343129.

I expect these failures to drop off now that debug runs are disabled for the twitch tests, and will keep an eye on this and other associated bugs to make sure that's the case (otherwise back to the drawing board for me).

Comment 3

[Intermittent Failures Robot]

20 failures in 790 pushes (0.025 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 8
* mozilla-central: 3
* graphics: 3
* try: 2
* mozilla-inbound: 2
* mozilla-esr52: 2

Platform breakdown:
* linux64: 9
* windows8-64: 3
* windows10-64-vm: 2
* osx-10-10: 2
* linux32: 2
* windows7-32: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-03-06&endday=2017-03-12&tree=all

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

Bryce, we have 43 instances of failures in this bug in the last 6 days:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-03-10&endday=2017-03-17&tree=all

Overall, most are opt and mixed between operating systems.  Is this something you could look into and help us come to a solution for fixing/disabling?

Comment 5

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

A scan of the results shows a number of Linux failures. I'd prefer to see no platform disabled, but given the sunsetting of these tests, it's my opinion that these tests should be disabled on Linux.

If not otherwise advised, I will removed these tests from the Linux test rotation (by removal of TaskCluster config). Please let me know if you disagree.

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

that seems valid and we will get some coverage on other platforms until these are formerly replaced

Comment 7

[Intermittent Failures Robot]

44 failures in 777 pushes (0.057 failures/push) were associated with this bug in the last 7 days. 

This is the #35 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 11
* mozilla-inbound: 10
* mozilla-central: 10
* try: 4
* oak: 3
* graphics: 3
* mozilla-aurora: 2
* mozilla-esr52: 1

Platform breakdown:
* linux64: 15
* linux32: 10
* windows7-32: 5
* osx-10-10: 5
* windows10-64-vm: 4
* windows8-64: 3
* windows7-32-vm: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-03-13&endday=2017-03-19&tree=all

Comment 8

[Intermittent Failures Robot]

17 failures in 174 pushes (0.098 failures/push) were associated with this bug yesterday.   

Repository breakdown:
* autoland: 5
* try: 4
* mozilla-inbound: 3
* mozilla-central: 2
* mozilla-aurora: 2
* mozilla-beta: 1

Platform breakdown:
* linux64: 7
* linux32: 5
* osx-10-10: 2
* windows8-64: 1
* windows7-32-vm: 1
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-03-21&endday=2017-03-21&tree=all

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

I assume when we turn off the external-media-tests for linux* that this will mostly go away

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

this looks to have gone away for the most part:)

Comment 11

[Intermittent Failures Robot]

49 failures in 898 pushes (0.055 failures/push) were associated with this bug in the last 7 days. 

This is the #23 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 13
* mozilla-aurora: 11
* mozilla-central: 8
* mozilla-inbound: 7
* try: 6
* mozilla-esr52: 2
* oak: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 13
* linux32: 13
* osx-10-10: 9
* windows8-64: 4
* windows7-32-vm: 4
* windows7-32: 3
* windows10-64-vm: 2
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-03-20&endday=2017-03-26&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 814 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1344632&startday=2017-06-12&endday=2017-06-18&tree=all