2057902 - skip tests with Nova design enabled if they fail permanently or frequently

Status: REOPENED

(Firefox :: Theme, task)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Re-enabling is tracked by the bugs which block bug 2049911.

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail permanently or frequently. r=ahal

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/1cd5155da24e
https://hg.mozilla.org/integration/autoland/rev/939c6d5bf2e8
skip tests with Nova design enabled if they fail permanently or frequently. r=webcompat-reviewers,twisniewski

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/825801038d4d
https://hg.mozilla.org/integration/autoland/rev/c1d14e9fa412
lint failure fix

Comment 4

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/939c6d5bf2e8
https://hg.mozilla.org/mozilla-central/rev/c1d14e9fa412

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail permanently or frequently: follow-up 1

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/4a4d08c644ef
https://hg.mozilla.org/integration/autoland/rev/447c4d7b3d8c
skip tests with Nova design enabled if they fail permanently or frequently: follow-up 1

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail permanently or frequently: follow-up 2

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/776dade1716e
https://hg.mozilla.org/integration/autoland/rev/2bd1ec8f6328
skip tests with Nova design enabled if they fail permanently or frequently: follow-up 2

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/4b4e59946a3d
https://hg.mozilla.org/mozilla-central/rev/be36ed55e648
skip tests with Nova design enabled if they fail permanently or frequently: follow-up 2

Comment 14

[Silaghi Andreea]

https://hg.mozilla.org/mozilla-central/rev/447c4d7b3d8c

Comment 15

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail permanently or frequently: follow-up 3

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/f7f30d78635e
https://hg.mozilla.org/integration/autoland/rev/b72fe3b0c972
skip tests with Nova design enabled if they fail permanently or frequently: follow-up 3

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/7398dbc78df0
https://hg.mozilla.org/integration/autoland/rev/51f945bf3e5f
skip tests with Nova design enabled if they fail permanently or frequently: browser_test_position_sticky.js

Comment 18

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail: test_console_assert.html

This started to fail after test_cached_messages.html had been disabled.

Comment 19

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 2057902 - skip tests with Nova design enabled if they fail: browser_browser_toolbox_fission_inspector.js

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/98dec3139efb
https://hg.mozilla.org/integration/autoland/rev/7c1fc9ee46a2
skip tests with Nova design enabled if they fail: test_console_assert.html

Comment 21

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/b7d7f3c53355
https://hg.mozilla.org/integration/autoland/rev/ca3cdf1601ca
skip tests with Nova design enabled if they fail: browser_browser_toolbox_fission_inspector.js

Comment 22

[Intermittent Failures Robot]

91 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 82
• mozilla-central: 9

Table

	a11y-checks-swr	cf-vt	msix	no_variant	swr	vt
linux2404-x86_64/asan					1
linux2404-x86_64/debug					1
linux2404-x86_64/opt	1			39
macosx1500-aarch64/opt		2		1		4
windows11-x86/debug				2
windows11-x86/opt				7
windows11-x86_64/asan				1
windows11-x86_64/debug			1
windows11-x86_64/opt			1	30

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2057902&startday=2026-07-27&endday=2026-07-27&tree=all

Comment 23

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/a3803eaf8ebd
https://hg.mozilla.org/mozilla-central/rev/ffb33055e80b
Revert "Bug 2057902 - skip tests with Nova design enabled if they fail permanently or frequently: follow-up 2" for causing conflicts with merge

Comment 24

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/2bd1ec8f6328
https://hg.mozilla.org/mozilla-central/rev/b72fe3b0c972
https://hg.mozilla.org/mozilla-central/rev/51f945bf3e5f

Comment 25

[rperta]

https://hg.mozilla.org/mozilla-central/rev/7c1fc9ee46a2
https://hg.mozilla.org/mozilla-central/rev/ca3cdf1601ca

Comment 26

[Intermittent Failures Robot]

91 failures were associated with this bug in the last 7 days.
This is the #40 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 82
• mozilla-central: 9

Table

	a11y-checks-swr	cf-vt	msix	no_variant	swr	vt
linux2404-x86_64/asan					1
linux2404-x86_64/debug					1
linux2404-x86_64/opt	1			39
macosx1500-aarch64/opt		2		1		4
windows11-x86/debug				2
windows11-x86/opt				7
windows11-x86_64/asan				1
windows11-x86_64/debug			1
windows11-x86_64/opt			1	30

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2057902&startday=2026-07-27&endday=2026-08-02&tree=all