1981063 - Artifact exe search fix (Clone of Perma [Tier2] Diffoscope firefox differs. See the diff.html or diff.txt artifact | single tracking bug)

Status: RESOLVED FIXED

(Firefox :: Installer, defect)

Description

[Chris DuPuis]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=519881976&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RUqVl2eQSfaJrHZT4_cAPg/runs/0/artifacts/public/logs/live_backing.log

---

 0%  …refox/vcruntime140_1.dll  ETA:  --:--:-- 
[task 2025-07-28T19:43:12.933+00:00]  |                          |    0%  b/firefox/wmfclearkey.dll  ETA:  --:--:-- 
[task 2025-07-28T19:43:13.043+00:00]  |                          |    0%          b/firefox/xul.dll  ETA:  --:--:-- 
[task 2025-07-28T19:43:13.043+00:00]  |                          |    0%                             ETA:  --:--:-- 
[task 2025-07-28T19:43:13.043+00:00]  |                          |    0%                             ETA:  --:--:-- 
[task 2025-07-28T19:43:13.043+00:00]  |                          |    0%                             ETA:  --:--:-- 
[task 2025-07-28T19:43:13.072+00:00]  |###########################|  100%                             Time: 0:00:15 
[task 2025-07-28T19:43:13.072+00:00] ++ dirname /builds/worker/bin/get_and_diffoscope
[task 2025-07-28T19:43:13.073+00:00] + /builds/worker/bin/report_error diff
[task 2025-07-28T19:43:13.082+00:00] TEST-UNEXPECTED-FAIL | firefox differs. See the diff.html or diff.txt artifact
[task 2025-07-28T19:43:13.084+00:00] + fail
[task 2025-07-28T19:43:13.084+00:00] + exit 1
[taskcluster 2025-07-28 19:43:15.924Z] === Task Finished ===
[taskcluster 2025-07-28 19:43:16.125Z] Unsuccessful task run with exit code: 1 completed in 54.511 second

Comment 1

[Chris DuPuis]

Attachment: Bug 1981063 - Artifact builds should include subdirs for exes r=glandium

A new desktop launcher .exe was added in the change for Bug 1968279.
Since it was added in a subdirectory of the main installation, the
current artifact logic was not finding it.

This change makes the artifact logic look in subdirectories for .exe
files, just as it does for .dll files.

https://bugzilla.mozilla.org/show_bug.cgi?id=1968279

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1968279

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/11f140c0d487
https://hg.mozilla.org/integration/autoland/rev/050bd45186e9
Artifact builds should include subdirs for exes r=glandium

Comment 4

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/050bd45186e9

Comment 6

[Mike Hommey [:glandium]]

Failures are still piling up in bug 1981063, so this didn't fix the problem, apparently.

Comment 7

[Intermittent Failures Robot]

18 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-08-28&endday=2025-08-28&tree=all

Comment 8

[Intermittent Failures Robot]

20 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 5

Table

	no_variant
linux-x86/unknown build	20

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-08-29&endday=2025-08-29&tree=all

Comment 9

[Intermittent Failures Robot]

115 failures were associated with this bug in the last 7 days.
This is the #15 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 97
• mozilla-central: 18

Table

	no_variant
linux-x86/unknown build	115

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-08-25&endday=2025-08-31&tree=all

Comment 10

[Intermittent Failures Robot]

19 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	19

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-04&endday=2025-09-04&tree=all

Comment 11

[Intermittent Failures Robot]

22 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 5

Table

	no_variant
linux-x86/unknown build	22

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-05&endday=2025-09-05&tree=all

Comment 12

[Intermittent Failures Robot]

107 failures were associated with this bug in the last 7 days.
This is the #17 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• mozilla-central: 21
• autoland: 86

Table

	no_variant
linux-x86/unknown build	107

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-01&endday=2025-09-07&tree=all

Comment 13

[Mike Hommey [:glandium]]

So, the problem is that DESKTOP_LAUNCHER_ENABLED is not defined when processing browser/installer/package-manifest.in in artifact builds.
But looking around for that define, I see a link to bug 1985118, which suggests the desktop-launcher shouldn't even be enabled in the first place, so we shouldn't even be talking about this bug?

Comment 14

[Intermittent Failures Robot]

15 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 1

Table

	no_variant
linux-x86/unknown build	15

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-08&endday=2025-09-08&tree=all

Comment 15

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	23

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-09&endday=2025-09-09&tree=all

Comment 16

[Intermittent Failures Robot]

17 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	17

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-10&endday=2025-09-10&tree=all

Comment 17

[Intermittent Failures Robot]

17 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	17

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-11&endday=2025-09-11&tree=all

Comment 18

[Intermittent Failures Robot]

81 failures were associated with this bug in the last 7 days.
This is the #14 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• mozilla-central: 13
• autoland: 68

Table

	no_variant
linux-x86/unknown build	81

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-08&endday=2025-09-14&tree=all

Comment 19

[Intermittent Failures Robot]

17 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	17

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-15&endday=2025-09-15&tree=all

Comment 20

[Intermittent Failures Robot]

25 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-central: 4

Table

	no_variant
linux-x86/unknown build	25

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-16&endday=2025-09-16&tree=all

Comment 21

[Intermittent Failures Robot]

18 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-17&endday=2025-09-17&tree=all

Comment 22

[Intermittent Failures Robot]

16 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	16

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-18&endday=2025-09-18&tree=all

Comment 23

[Intermittent Failures Robot]

22 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	22

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-19&endday=2025-09-19&tree=all

Comment 24

[Intermittent Failures Robot]

109 failures were associated with this bug in the last 7 days.
This is the #18 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 92
• mozilla-central: 17

Table

	no_variant
linux-x86/unknown build	109

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-15&endday=2025-09-21&tree=all

Comment 25

[Intermittent Failures Robot]

24 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 5

Table

	no_variant
linux-x86/unknown build	24

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-22&endday=2025-09-22&tree=all

Comment 26

[Cristina Horotan [:chorotan]]

There already are 111 failures in the last 7 days, are any updates?

Comment 27

[Intermittent Failures Robot]

18 failures were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 3
• autoland: 15

Table

	no_variant
linux-x86/unknown build	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-23&endday=2025-09-23&tree=all

Comment 28

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• try: 1
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	23

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-24&endday=2025-09-24&tree=all

Comment 29

[Intermittent Failures Robot]

19 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	19

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-25&endday=2025-09-25&tree=all

Comment 30

[Intermittent Failures Robot]

21 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	21

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-26&endday=2025-09-26&tree=all

Comment 31

[Intermittent Failures Robot]

122 failures were associated with this bug in the last 7 days.
This is the #14 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 101
• try: 1
• mozilla-central: 20

Table

	no_variant
linux-x86/unknown build	122

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-22&endday=2025-09-28&tree=all

Comment 32

[Intermittent Failures Robot]

21 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	21

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-29&endday=2025-09-29&tree=all

Comment 33

[Intermittent Failures Robot]

15 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	15

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-30&endday=2025-09-30&tree=all

Comment 34

[Intermittent Failures Robot]

26 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 22
• mozilla-central: 4

Table

	no_variant
linux-x86/unknown build	26

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-01&endday=2025-10-01&tree=all

Comment 35

[Joel Maher ( :jmaher ) (UTC -8)]

with no action, I am going to submit a patch to disable this task as it is just burning CPU time.

Comment 36

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1981063 - disable win64a task as it is perma failing and wasting cpu. r=#intermittent-reviewers

Comment 37

[Joel Maher ( :jmaher ) (UTC -8)]

:glandium, as you are concerned with my patch to disable, can you please work on fixing this bug? I don't understand why it is perma fail and no action on it for weeks.

Comment 38

[Mike Hommey [:glandium]]

Attachment: Bug 1981063 - Consistently enable desktop launcher in artifact vs. normal builds.

Comment 39

[Mike Hommey [:glandium]]

Attachment: Bug 1981063 - Remove unnecessary stanzas for desktop-launcher tests.

Comment 40

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	23

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-02&endday=2025-10-02&tree=all

Comment 41

[Intermittent Failures Robot]

21 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 4

Table

	no_variant
linux-x86/unknown build	21

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-03&endday=2025-10-03&tree=all

Comment 42

[Intermittent Failures Robot]

116 failures were associated with this bug in the last 7 days.
This is the #10 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 98
• mozilla-central: 18

Table

	no_variant
linux-x86/unknown build	116

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-09-29&endday=2025-10-05&tree=all

Comment 43

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	23

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-06&endday=2025-10-06&tree=all

Comment 44

[Intermittent Failures Robot]

18 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-07&endday=2025-10-07&tree=all

Comment 45

[Intermittent Failures Robot]

19 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	19

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-08&endday=2025-10-08&tree=all

Comment 46

[Intermittent Failures Robot]

23 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 4

Table

	no_variant
linux-x86/unknown build	23

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-09&endday=2025-10-09&tree=all

Comment 47

[Intermittent Failures Robot]

105 failures were associated with this bug in the last 7 days.
This is the #7 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 84
• mozilla-central: 21

Table

	no_variant
linux-x86/unknown build	105

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-06&endday=2025-10-12&tree=all

Comment 48

[Intermittent Failures Robot]

18 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-13&endday=2025-10-13&tree=all

Comment 49

[Intermittent Failures Robot]

22 failures were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 6
• autoland: 16

Table

	no_variant
linux-x86/unknown build	22

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-14&endday=2025-10-14&tree=all

Comment 50

[Intermittent Failures Robot]

17 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	17

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-15&endday=2025-10-15&tree=all

Comment 51

[Intermittent Failures Robot]

31 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 8

Table

	no_variant
linux-x86/unknown build	31

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-16&endday=2025-10-16&tree=all

Comment 52

[Intermittent Failures Robot]

21 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 3

Table

	no_variant
linux-x86/unknown build	21

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-17&endday=2025-10-17&tree=all

Comment 53

[Intermittent Failures Robot]

128 failures were associated with this bug in the last 7 days.
This is the #12 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• mozilla-central: 26
• autoland: 102

Table

	no_variant
linux-x86/unknown build	128

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-13&endday=2025-10-19&tree=all

Comment 54

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/977d1ecafcd4
https://hg.mozilla.org/integration/autoland/rev/5c83443c834e
Consistently enable desktop launcher in artifact vs. normal builds. r=firefox-build-system-reviewers,cdupuis,browser-installer-reviewers,sergesanspaille
https://github.com/mozilla-firefox/firefox/commit/7c4c01f032d1
https://hg.mozilla.org/integration/autoland/rev/92a85f25f361
Remove unnecessary stanzas for desktop-launcher tests. r=firefox-build-system-reviewers,cdupuis,sergesanspaille

Comment 55

[Intermittent Failures Robot]

20 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 2

Table

	no_variant
linux-x86/unknown build	20

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-20&endday=2025-10-20&tree=all

Comment 56

[amarc]

https://hg.mozilla.org/mozilla-central/rev/5c83443c834e
https://hg.mozilla.org/mozilla-central/rev/92a85f25f361

Comment 57

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/35e99bf18424
https://hg.mozilla.org/mozilla-central/rev/008cce8390fa
Revert "Bug 1981063 - Remove unnecessary stanzas for desktop-launcher tests. r=firefox-build-system-reviewers,cdupuis,sergesanspaille" for causing L10n bustages

Comment 58

[Cristina Horotan [:chorotan]]

Backed out here: https://hg.mozilla.org/mozilla-central/rev/008cce8390faeef88d165c1579e23bb33e748264

Comment 59

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/fea310fb940b
https://hg.mozilla.org/integration/autoland/rev/03a8daa52b79
Consistently enable desktop launcher in artifact vs. normal builds. r=firefox-build-system-reviewers,cdupuis,browser-installer-reviewers,sergesanspaille
https://github.com/mozilla-firefox/firefox/commit/882920db636f
https://hg.mozilla.org/integration/autoland/rev/a60704405e23
Remove unnecessary stanzas for desktop-launcher tests. r=firefox-build-system-reviewers,cdupuis,sergesanspaille

Comment 60

[amarc]

https://hg.mozilla.org/mozilla-central/rev/03a8daa52b79
https://hg.mozilla.org/mozilla-central/rev/a60704405e23

Comment 61

[Intermittent Failures Robot]

36 failures were associated with this bug in the last 7 days.

This failure happened more than 30 times this week! Resolving this bug is a high priority.

Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 32
• mozilla-central: 4

Table

	no_variant
linux-x86/unknown build	36

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1981063&startday=2025-10-20&endday=2025-10-26&tree=all