1950763 - Remove tons of flaky annotations once we have webrender snapshotting

Status: NEW

(Core :: CSS Parsing and Computation, task)

Description

[Emilio Cobos Álvarez (:emilio)]

Bug 1919333 landed with a whack-a-mole of test annotation fixes, mostly due to a mix of:

• Tests somehow not running on try due to the silly backlog stuff. We did run most of them on autoland even, and some tests snuck by.
• Fuzz caused from the non-webrender fallback snapshotting. This causes thousands of pixels off by one color channel component or so.

I'm moderately sure that once we get bug 1922333 and it sticks we can remove most of these.

Comment 1

[Intermittent Failures Robot]

Summary

50 failures in 1028 pushes (0.049 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 27
• mozilla-central: 19
• try: 4

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-qr: 6
  • debug: 3
  • opt: 3
• linux1804-64-asan-qr: 3
  • opt: 3
• linux1804-64-qr: 8
  • debug: 2
  • opt: 6
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 12
  • opt: 10
  • debug: 2
• windows11-64-24h2: 15
  • opt: 10
  • debug: 5
• windows11-64-24h2-ccov: 1
  • opt: 1
• windows11-64-24h2-devedition: 1
  • opt: 1

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		3
android-em-7-0-x86_64-qr--/debug		3
android-em-7-0-x86_64-qr--/opt	1	2
linux1804-64-asan-qr--/opt	2	1
linux1804-64-qr--/debug	2
linux1804-64-qr--/opt	4	1	1
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/opt	10
macosx1470-64--/debug	2
windows11-64-24h2--/opt	10
windows11-64-24h2--/debug	1			4
windows11-64-24h2-ccov--/opt	1
windows11-64-24h2-devedition--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-02-27&endday=2025-02-27&tree=all

Comment 2

[Intermittent Failures Robot]

Summary

32 failures in 723 pushes (0.044 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 15
• try: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 4
  • opt: 1
• android-em-7-0-x86_64-lite-qr: 4
  • opt: 4
• linux1804-64-asan-qr: 4
  • opt: 4
• linux1804-64-qr: 6
  • debug: 4
  • opt: 2
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 6
  • opt: 6
• macosx1470-64-devedition: 1
  • opt: 1
• windows11-64-24h2: 4
  • debug: 1
  • opt: 3
• windows11-64-24h2-devedition: 1
  • opt: 1

Table

	no_variant	nofis
android-em-7-0-x86_64-qr--/debug		4
android-em-7-0-x86_64-lite-qr--/opt		4
android-em-7-0-x86_64-qr--/opt		1
linux1804-64-asan-qr--/opt	4
linux1804-64-qr--/debug	2	2
linux1804-64-qr--/opt	2
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/opt	6
macosx1470-64-devedition--/opt	1
windows11-64-24h2--/debug	1
windows11-64-24h2-devedition--/opt	1
windows11-64-24h2--/opt	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-02-28&endday=2025-02-28&tree=all

Comment 4

[Intermittent Failures Robot]

Summary

102 failures in 4564 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #5 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 49
• mozilla-central: 43
• try: 10

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 8
  • opt: 8
• android-em-7-0-x86_64-qr: 21
  • opt: 4
  • debug: 17
• linux1804-64-asan-qr: 11
  • opt: 11
• linux1804-64-qr: 15
  • debug: 6
  • opt: 9
• linux1804-64-tsan-qr: 5
  • opt: 5
• macosx1470-64: 19
  • debug: 2
  • opt: 17
• macosx1470-64-devedition: 1
  • opt: 1
• windows11-64-24h2: 19
  • debug: 6
  • opt: 13
• windows11-64-24h2-ccov: 1
  • opt: 1
• windows11-64-24h2-devedition: 2
  • opt: 2

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		8
android-em-7-0-x86_64-qr--/opt	1	3
android-em-7-0-x86_64-qr--/debug		17
linux1804-64-asan-qr--/opt	9	2
linux1804-64-qr--/debug	4	2
linux1804-64-qr--/opt	6	1	2
linux1804-64-tsan-qr--/opt	5
macosx1470-64--/debug	2
macosx1470-64--/opt	17
macosx1470-64-devedition--/opt	1
windows11-64-24h2--/debug	2			4
windows11-64-24h2--/opt	13
windows11-64-24h2-ccov--/opt	1
windows11-64-24h2-devedition--/opt	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-02-24&endday=2025-03-02&tree=all

Comment 5

[Intermittent Failures Robot]

Summary

16 failures in 922 pushes (0.017 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-central: 7

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8
• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-qr: 1
  • opt: 1
• macosx1470-64: 2
  • debug: 2

Table

	no_variant	nofis
android-em-7-0-x86_64-qr--/debug		8
linux1804-64-asan-qr--/opt	4	1
linux1804-64-qr--/opt		1
macosx1470-64--/debug	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-04&endday=2025-03-04&tree=all

Comment 6

[Intermittent Failures Robot]

Summary

18 failures in 834 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 7
• mozilla-central: 6
• mozilla-beta: 4
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 6
• linux1804-64-asan-qr: 9
  • opt: 9
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 2
  • debug: 2

Table

	no_variant	nofis
android-em-7-0-x86_64-qr--/debug		6
linux1804-64-asan-qr--/opt	5	4
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/debug	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-05&endday=2025-03-05&tree=all

Comment 7

[Intermittent Failures Robot]

Summary

21 failures in 939 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 7
• mozilla-central: 1
• mozilla-beta: 13

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 4
  • debug: 4
• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-qr: 5
  • debug: 3
  • opt: 2
• macosx1470-64: 4
  • debug: 3
  • opt: 1
• windows11-64-24h2: 1
  • debug: 1

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		2
android-em-7-0-x86_64-qr--/debug		3	1
linux1804-64-asan-qr--/opt	4	1
linux1804-64-qr--/debug	3
linux1804-64-qr--/opt	2
macosx1470-64--/debug	3
macosx1470-64--/opt	1
windows11-64-24h2--/debug				1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-06&endday=2025-03-06&tree=all

Comment 8

[Intermittent Failures Robot]

Summary

77 failures in 4009 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 31
• mozilla-central: 21
• mozilla-beta: 21
• try: 4

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 27
  • debug: 27
• linux1804-64-asan-qr: 23
  • opt: 23
• linux1804-64-qr: 6
  • debug: 3
  • opt: 3
• linux1804-64-tsan-qr: 2
  • opt: 2
• macosx1470-64: 15
  • debug: 12
  • opt: 3
• macosx1470-64-devedition: 1
  • opt: 1
• windows11-64-24h2: 1
  • debug: 1

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		2
android-em-7-0-x86_64-qr--/debug		26	1
linux1804-64-asan-qr--/opt	13	10
linux1804-64-qr--/debug	3
linux1804-64-qr--/opt	2	1
linux1804-64-tsan-qr--/opt	2
macosx1470-64--/debug	12
macosx1470-64-devedition--/opt	1
macosx1470-64--/opt	3
windows11-64-24h2--/debug				1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-03&endday=2025-03-09&tree=all

Comment 9

[Intermittent Failures Robot]

Summary

31 failures in 876 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• try: 3
• mozilla-beta: 10
• mozilla-central: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 14
  • debug: 12
  • opt: 2
• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 3
  • debug: 3
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 5
  • debug: 5
• windows11-64-24h2: 2
  • debug: 1
  • opt: 1

Table

	no_variant	nofis	swr
android-em-7-0-x86_64-qr--/debug		12
android-em-7-0-x86_64-qr--/opt		2
linux1804-64-asan-qr--/opt	5
linux1804-64-ccov-qr--/opt	1
linux1804-64-qr--/debug	3
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/debug	5
windows11-64-24h2--/debug			1
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-12&endday=2025-03-12&tree=all

Comment 10

[Intermittent Failures Robot]

Summary

15 failures in 1091 pushes (0.014 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 2
• mozilla-beta: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 7
  • opt: 1
• linux1804-64-asan-qr: 4
  • opt: 4
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 2
  • debug: 2

Table

	no_variant	nofis	nofis-swr
android-em-7-0-x86_64-qr--/debug		3	4
android-em-7-0-x86_64-qr--/opt		1
linux1804-64-asan-qr--/opt	4
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/debug	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-13&endday=2025-03-13&tree=all

Comment 11

[Intermittent Failures Robot]

Summary

15 failures in 788 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 6
• mozilla-central: 8
• mozilla-beta: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 4
  • debug: 4
• linux1804-64-qr: 3
  • debug: 2
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1470-64: 2
  • debug: 2
• windows11-64-24h2: 3
  • debug: 2
  • opt: 1

Table

	no_variant	nofis	nofis-swr
android-em-7-0-x86_64-lite-qr--/opt		2
android-em-7-0-x86_64-qr--/debug		1	3
linux1804-64-qr--/debug			2
linux1804-64-qr--/opt			1
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/debug	2
windows11-64-24h2--/debug	2
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-14&endday=2025-03-14&tree=all

Comment 12

[Intermittent Failures Robot]

Summary

92 failures in 4826 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 40
• mozilla-central: 31
• try: 5
• mozilla-beta: 16

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 7
  • opt: 7
• android-em-7-0-x86_64-qr: 39
  • debug: 34
  • opt: 5
• linux1804-64-asan-qr: 11
  • opt: 11
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 10
  • debug: 5
  • opt: 5
• linux1804-64-tsan-qr: 3
  • opt: 3
• macosx1470-64: 12
  • debug: 10
  • opt: 2
• windows11-64-24h2: 9
  • debug: 4
  • opt: 5

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		7
android-em-7-0-x86_64-qr--/debug		21	13
android-em-7-0-x86_64-qr--/opt		5
linux1804-64-asan-qr--/opt	10		1
linux1804-64-ccov-qr--/opt	1
linux1804-64-qr--/debug	3		2
linux1804-64-qr--/opt	1	2	2
linux1804-64-tsan-qr--/opt	3
macosx1470-64--/debug	10
macosx1470-64--/opt	2
windows11-64-24h2--/debug	3			1
windows11-64-24h2--/opt	5

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-10&endday=2025-03-16&tree=all

Comment 13

[Intermittent Failures Robot]

Summary

15 failures in 1018 pushes (0.015 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 7
• mozilla-central: 1
• mozilla-beta: 6
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 5
  • opt: 1
• linux1804-64-asan-qr: 3
  • opt: 3
• macosx1470-64: 5
  • opt: 1
  • debug: 4
• windows11-64-24h2: 1
  • opt: 1

Table

	no_variant	nofis	nofis-swr
android-em-7-0-x86_64-qr--/debug		4	1
android-em-7-0-x86_64-qr--/opt		1
linux1804-64-asan-qr--/opt	3
macosx1470-64--/opt	1
macosx1470-64--/debug	4
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-18&endday=2025-03-18&tree=all

Comment 14

[Intermittent Failures Robot]

Summary

35 failures in 5035 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #43 most frequent failure this week.

This failure happened more than 30 times this week! Resolving this bug is a high priority.

Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 11
• mozilla-central: 6
• mozilla-beta: 16
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 8
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 6
  • opt: 6
• linux1804-64-qr: 8
  • debug: 6
  • opt: 2
• macosx1470-64: 7
  • debug: 6
  • opt: 1
• macosx1470-64-devedition: 2
  • opt: 2
• windows11-64-24h2: 1
  • opt: 1

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-qr--/debug		7	1
android-em-7-0-x86_64-qr--/opt		2
android-em-7-0-x86_64-lite-qr--/opt		1
linux1804-64-asan-qr--/opt	6
linux1804-64-qr--/debug	4	1		1
linux1804-64-qr--/opt	1	1
macosx1470-64--/debug	6
macosx1470-64--/opt	1
macosx1470-64-devedition--/opt	2
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-17&endday=2025-03-23&tree=all

Comment 15

[Intermittent Failures Robot]

Repository breakdown:

• autoland: 11
• mozilla-central: 5

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		7
android-em-7-0-x86_64-qr--/debug		2
linux1804-64-asan-qr--/opt	1
linux1804-64-ccov-qr--/opt	1
linux1804-64-qr--/debug			2
linux1804-64-qr--/opt	1
windows11-64-24h2--/debug				1
windows11-64-24h2-ccov--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-26&endday=2025-03-26&tree=all

Comment 16

[Intermittent Failures Robot]

This is the #41 most frequent failure this week.

Repository breakdown:

• autoland: 11
• mozilla-central: 12
• mozilla-beta: 5

Table

	no_variant	nofis	nofis-swr	swr
android-em-7-0-x86_64-lite-qr--/opt		8
android-em-7-0-x86_64-qr--/debug		2
android-em-7-0-x86_64-qr--/opt		1
linux1804-64-asan-qr--/opt	2
linux1804-64-ccov-qr--/opt	1
linux1804-64-devedition-qr--/opt	1
linux1804-64-qr--/opt	3
linux1804-64-qr--/debug	1		2
macosx1470-64--/debug	2
macosx1470-64--/opt	1
windows11-64-24h2--/debug				1
windows11-64-24h2-ccov--/opt	2
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-24&endday=2025-03-30&tree=all

Comment 17

[Intermittent Failures Robot]

2 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 1

Table

	no_variant
linux1804-64-asan-qr--/opt	1
linux1804-64-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-03-31&endday=2025-04-06&tree=all

Comment 18

[Intermittent Failures Robot]

4 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 4

Table

	no_variant
linux1804-64-devedition-qr--/opt	2
linux1804-64-tsan-qr--/opt	1
macosx1470-64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-04-07&endday=2025-04-13&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Table

	no_variant
linux1804-64-tsan-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-04-14&endday=2025-04-20&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Table

	no_variant
linux1804-x86_64/tsan	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1950763&startday=2025-05-05&endday=2025-05-11&tree=all