1781539 - [wmfme] Perma dom/media/test/test_loop.html | single tracking bug

Status: RESOLVED FIXED

(Core :: Audio/Video: Playback, defect, P3)

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Additional information about this bug failures and frequency patterns can be found by running: ./mach test-info failure-report --bug 1781539

Comment 3

[Intermittent Failures Robot]

30 failures in 679 pushes (0.044 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-central: 9

Platform and build breakdown:

• windows10-64-2004-qr: 13
  • debug: 9
  • opt: 4
• windows10-64-2004-asan-qr: 9
  • opt: 9
• windows10-64-2004-shippable-qr: 5
  • opt: 5
• windows10-64-2004-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-13&endday=2022-10-13&tree=all

Comment 4

[Narcis Beleuzu [:NarcisB]]

This started to almost perma fail on Windows 10 x64 2004 WebRender opt
There are 57 failures in the last 2 days.
:alwu , can you please take a look?

Comment 5

[Alastor Wu [:alwu]]

Yes, that is something already in my radar. All failures are mochitest-media-wmfme which is a new tier 2 test task, the failure won't affect other test tasks on the try server.

Comment 6

[Alastor Wu [:alwu]]

This is not permanent, I haven't been able to reproduce this on the try server yet.

Comment 7

[Intermittent Failures Robot]

33 failures in 628 pushes (0.053 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 22
• mozilla-central: 11

Platform and build breakdown:

• windows10-64-2004-qr: 17
  • opt: 7
  • debug: 10
• windows10-64-2004-asan-qr: 4
  • opt: 4
• windows10-64-2004-shippable-qr: 8
  • opt: 8
• windows10-64-2004-ccov-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-14&endday=2022-10-14&tree=all

Comment 8

[Intermittent Failures Robot]

87 failures in 3034 pushes (0.029 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 61
• mozilla-central: 26

Platform and build breakdown:

• windows10-64-2004-qr: 40
  • debug: 24
  • opt: 16
• windows10-64-2004-shippable-qr: 21
  • opt: 21
• windows10-64-2004-asan-qr: 17
  • opt: 17
• windows10-64-2004-ccov-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 9

[Norisz Fay [:noriszfay]]

Hello, this is mostly perma-failing on central and autoland (e.g. on central) (since they are configured the same), it could be that try is not catching this failure and that is why it's appearing on the other 2 trees only. Will change the summary back to perma for the time being.

Comment 10

[Alastor Wu [:alwu]]

Okay good to know that the failure rate is different between the try server and the central/autoland.

Could we simply ignore this test failure (and any test failures happening on wmfme) and keep the test in the tree, instead of disabling the test? Because wmfme is a tier 2 test task for the new feature which hasn't been enabled yet, so we need to track those failures and fix them one by one until the feature becomes stable. Then we would make wmfme be a tier 1 task, which means any test failures would be treated in the same guideline.

Thanks.

Comment 11

[Cristian Tuns]

Hi, we will ignore it until you can find a fix for it, thank for looking into this.

Comment 12

[Intermittent Failures Robot]

28 failures in 560 pushes (0.05 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 19
• autoland: 9

Platform and build breakdown:

• windows10-64-2004-qr: 9
  • debug: 5
  • opt: 4
• windows10-64-2004-asan-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 15
  • opt: 15
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-17&endday=2022-10-17&tree=all

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1790463

Comment 14

[Intermittent Failures Robot]

19 failures in 646 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 4

Platform and build breakdown:

• windows10-64-2004-qr: 10
  • opt: 5
  • debug: 5
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-18&endday=2022-10-18&tree=all

Comment 15

[Intermittent Failures Robot]

29 failures in 629 pushes (0.046 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 22
• mozilla-central: 7

Platform and build breakdown:

• windows10-64-2004-qr: 12
  • opt: 6
  • debug: 6
• windows10-64-2004-shippable-qr: 9
  • opt: 9
• windows10-64-2004-asan-qr: 6
  • opt: 6
• windows10-64-2004-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-19&endday=2022-10-19&tree=all

Comment 16

[Intermittent Failures Robot]

36 failures in 600 pushes (0.06 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 27
• mozilla-central: 9

Platform and build breakdown:

• windows10-64-2004-qr: 22
  • debug: 18
  • opt: 4
• windows10-64-2004-shippable-qr: 9
  • opt: 9
• windows10-64-2004-ccov-qr: 2
  • opt: 2
• windows10-64-2004-asan-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-20&endday=2022-10-20&tree=all

Comment 17

[Intermittent Failures Robot]

21 failures in 204 pushes (0.103 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 8

Platform and build breakdown:

• windows10-64-2004-qr: 7
  • debug: 4
  • opt: 3
• windows10-64-2004-asan-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 8
  • opt: 8
• windows10-64-2004-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-21&endday=2022-10-21&tree=all

Comment 18

[Intermittent Failures Robot]

152 failures in 2793 pushes (0.054 failures/push) were associated with this bug in the last 7 days.

This is the #5 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 56
• autoland: 95
• try: 1

Platform and build breakdown:

• windows10-64-2004-qr: 68
  • debug: 44
  • opt: 24
• windows10-64-2004-asan-qr: 24
  • opt: 24
• windows10-64-2004-shippable-qr: 49
  • opt: 49
• windows10-64-2004-ccov-qr: 11
  • opt: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 19

[Intermittent Failures Robot]

17 failures in 625 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 5
• autoland: 12

Platform and build breakdown:

• windows10-64-2004-qr: 7
  • debug: 3
  • opt: 4
• windows10-64-2004-asan-qr: 6
  • opt: 6
• windows10-64-2004-ccov-qr: 1
  • opt: 1
• windows10-64-2004-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-24&endday=2022-10-24&tree=all

Comment 20

[Intermittent Failures Robot]

22 failures in 532 pushes (0.041 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 16
• mozilla-central: 4
• try: 2

Platform and build breakdown:

• windows10-64-2004-qr: 10
  • debug: 6
  • opt: 4
• windows10-64-2004-shippable-qr: 6
  • opt: 6
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-25&endday=2022-10-25&tree=all

Comment 21

[Intermittent Failures Robot]

29 failures in 770 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 22
• mozilla-central: 7

Platform and build breakdown:

• windows10-64-2004-qr: 15
  • debug: 8
  • opt: 7
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 8
  • opt: 8
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-26&endday=2022-10-26&tree=all

Comment 22

[Intermittent Failures Robot]

28 failures in 875 pushes (0.032 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 7
• try: 1

Platform and build breakdown:

• windows10-64-2004-qr: 16
  • debug: 8
  • opt: 8
• windows10-64-2004-shippable-qr: 8
  • opt: 8
• windows10-64-2004-ccov-qr: 1
  • opt: 1
• windows10-64-2004-asan-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-27&endday=2022-10-27&tree=all

Comment 23

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1781539 - add toggle 'wmfme' to mochitest runner to skip tests executed with this variant. r=jmaher

Comment 24

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1781539 - disable dom/media/test/test_loop.html in windows media foundation variant. r=alwu

Depends on D160691

Comment 25

[Intermittent Failures Robot]

27 failures in 688 pushes (0.039 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 19
• mozilla-central: 8

Platform and build breakdown:

• windows10-64-2004-qr: 12
  • debug: 7
  • opt: 5
• windows10-64-2004-shippable-qr: 5
  • opt: 5
• windows10-64-2004-asan-qr: 8
  • opt: 8
• windows10-64-2004-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-28&endday=2022-10-28&tree=all

Comment 26

[Intermittent Failures Robot]

17 failures in 131 pushes (0.13 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 6

Platform and build breakdown:

• windows10-64-2004-qr: 6
  • opt: 3
  • debug: 3
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 5
  • opt: 5
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-29&endday=2022-10-29&tree=all

Comment 27

[Intermittent Failures Robot]

153 failures in 3743 pushes (0.041 failures/push) were associated with this bug in the last 7 days.

This is the #4 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 43
• autoland: 105
• try: 5

Platform and build breakdown:

• windows10-64-2004-qr: 73
  • debug: 40
  • opt: 33
• windows10-64-2004-asan-qr: 34
  • opt: 34
• windows10-64-2004-ccov-qr: 8
  • opt: 8
• windows10-64-2004-shippable-qr: 38
  • opt: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 28

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c22ae0b1a20c
add toggle 'wmfme' to mochitest runner to skip tests executed with this variant. r=jmaher
https://hg.mozilla.org/integration/autoland/rev/b114715a2220
disable dom/media/test/test_loop.html in windows media foundation variant. r=alwu

Comment 29

[Marian-Vasile Laza]

https://hg.mozilla.org/mozilla-central/rev/c22ae0b1a20c
https://hg.mozilla.org/mozilla-central/rev/b114715a2220

Comment 30

[Intermittent Failures Robot]

15 failures in 571 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 7
• mozilla-central: 5
• try: 3

Platform and build breakdown:

• windows10-64-2004-qr: 5
  • debug: 2
  • opt: 3
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-31&endday=2022-10-31&tree=all

Comment 31

[Intermittent Failures Robot]

15 failures in 3626 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 5
• try: 3

Platform and build breakdown:

• windows10-64-2004-qr: 5
  • debug: 2
  • opt: 3
• windows10-64-2004-asan-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 3589 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781539&startday=2022-11-14&endday=2022-11-20&tree=all