2023756 - Perma mozlint [tier 2] tools/lint/test/test_codespell.py::test_lint_codespell[codespell] TEST-UNEXPECTED-FAIL

Status: RESOLVED FIXED

(Developer Infrastructure :: Lint and Formatting, defect)

Description

[Treeherder Bug Filer]

Filed by: rperta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=554026140&repo=autoland&task=NqMvHRZ3S1G2jTTtTtFXNw.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NqMvHRZ3S1G2jTTtTtFXNw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2026-03-16T23:24:38.124+00:00] tools/lint/test/test_codespell.py::test_lint_codespell_fix[codespell] PASSED
[task 2026-03-16T23:24:38.124+00:00] tools/lint/test/test_codespell.py::test_lint_codespell[codespell] TEST-UNEXPECTED-FAIL
[task 2026-03-16T23:24:38.124+00:00] 
[task 2026-03-16T23:24:38.124+00:00] =================================== FAILURES ===================================
[task 2026-03-16T23:24:38.124+00:00] ________________________ test_lint_codespell[codespell] ________________________
[task 2026-03-16T23:24:38.124+00:00] tools/lint/test/test_codespell.py:23: in test_lint_codespell
[task 2026-03-16T23:24:38.124+00:00]     assert len(results) == 2
[task 2026-03-16T23:24:38.124+00:00] E   AssertionError: assert 4 == 2
[task 2026-03-16T23:24:38.124+00:00] E    +  where 4 = len([Issue(linter='codespell', path='/builds/worker/checkouts/gecko/tools/lint/test/files/codespell/  /tmp/pytest-of-worker/pytest-3/test_lint_codespell_fix_codesp0/ignore.rst', lineno=1, column=None, message='informations ==> information', hint=None, source=None, level='error', rule=None, lineoffset=None, diff=None, relpath='  /tmp/pytest-of-worker/pytest-3/test_lint_codespell_fix_codesp0/ignore.rst'), Issue(linter='codespell', path='/builds/worker/checkouts/gecko/tools/lint/test/files/codespell/  /tmp/pytest-of-worker/pytest-3/test_lint_codespell_fix_codesp0/ignore.rst', lineno=5, column=None, message='mozila ==> mozilla', hint=None, source=None, level='error', rule=None, lineoffset=None, diff=None, relpath='  /tmp/pytest-of-worker/pytest-3/test_lint_codespell_fix_codesp0/ignore.rst'), Issue(linter='codespell', path='/builds/worker/checkouts/gecko/tools/lint/test/files/codespell/ignore.rst', lineno=1, column=None, message='informations ==> information', hint=None, source=None, level='error', rule=None, lineoffset=None, diff=None, relpath='ignore.rst'), Issue(linter='codespell', path='/builds/worker/checkouts/gecko/tools/lint/test/files/codespell/ignore.rst', lineno=5, column=None, message='mozila ==> mozilla', hint=None, source=None, level='error', rule=None, lineoffset=None, diff=None, relpath='ignore.rst')])
[task 2026-03-16T23:24:38.124+00:00] ------------------------------ Captured log call -------------------------------
[task 2026-03-16T23:24:38.124+00:00] DEBUG    mozlint:__init__.py:123 Command: /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/python-test/bin/python /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/python-test/bin/codespell --disable-colors --quiet-level=7 --ignore-words=/builds/worker/checkouts/gecko/tools/lint/spell/exclude-list.txt --skip=*.dic,devtools/docs/contributor/tools/storage/,remote/test/puppeteer/,tools/lint/cpp/mingw-headers.txt,tools/lint/test/test_codespell.py,**/package-lock.json
[task 2026-03-16T23:24:38.124+00:00] DEBUG    mozlint:__init__.py:124 Version: 2.4.2
[task 2026-03-16T23:24:38.124+00:00] ========================= 1 failed, 1 passed in 1.92s ==========================
[task 2026-03-16T23:24:38.124+00:00] 
[task 2026-03-16T23:24:38.124+00:00] 
[task 2026-03-16T23:24:38.124+00:00] Tests Completed: 100%|██████████| 42/42 [01:46<00:00,  2.54s/Test]
[task 2026-03-16T23:24:38.124+00:00] Return code from mach python-test: 1
[taskcluster 2026-03-16T23:24:39.227Z]                        Exit Code: 1
[taskcluster 2026-03-16T23:24:39.227Z]                        User Time: 20.133ms
[taskcluster 2026-03-16T23:24:39.227Z]                      Kernel Time: 27.18ms
[taskcluster 2026-03-16T23:24:39.227Z]                        Wall Time: 2m5.797958088s
[taskcluster 2026-03-16T23:24:39.227Z]  Average Available System Memory: 28.42 GiB
[taskcluster 2026-03-16T23:24:39.227Z]       Average System Memory Used: 2.92 GiB
[taskcluster 2026-03-16T23:24:39.227Z]          Peak System Memory Used: 3.72 GiB
[taskcluster 2026-03-16T23:24:39.227Z]              Total System Memory: 31.34 GiB
[taskcluster 2026-03-16T23:24:39.227Z]                           Result: FAILED
[taskcluster 2026-03-16T23:24:39.228Z] === Task Finished ===
[taskcluster 2026-03-16T23:24:39.228Z] Task Duration: 2m5.798348238s
[taskcluster 2026-03-16T23:24:41.128Z] [mounts] Preserving cache: Moving "/home/task_177370335127673/cache0" to "/home/generic-worker/caches/em3ZP8wiSKCwYCrmEOivtw"
[taskcluster 2026-03-16T23:24:41.128Z] [mounts] Preserving cache: Moving "/home/task_177370335127673/cache1" to "/home/generic-worker/caches/U91_B4CfTpeEx2Hg61_zvw"
[taskcluster 2026-03-16T23:24:41.128Z] [mounts] Preserving cache: Moving "/home/task_177370335127673/cache2" to "/home/generic-worker/caches/B9S4gITxTn25uoEdUH9cNg"
[taskcluster:error] exit status 1

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 2023377

:Sylvestre, since you are the author of the regressor, bug 2023377, could you take a look? Also, could you set the severity field?

For more information, please visit BugBot documentation.

Comment 2

[Intermittent Failures Robot]

19 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 19

Table

	msix	no_variant
linux2404-x86_64/opt		13
macosx1470-x86_64/opt		1
windows11-x86/opt		2
windows11-x86_64/opt	2	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-03-16&endday=2026-03-16&tree=all

Comment 3

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 2023756 - Fix codespell test intermittent failure by using unique temp filename r?#linter-reviewers

The test_lint_codespell_fix test was creating a temporary file named "ignore.rst",
which conflicted with the existing test file in files/codespell/ignore.rst.
This caused codespell to find duplicate results when running tests in sequence.

Fixed by renaming the temporary file to "test_fix_temp.rst" to avoid the naming conflict.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/c5512997c892
https://hg.mozilla.org/integration/autoland/rev/d93ff2fe8e68
Fix codespell test intermittent failure by using unique temp filename r=linter-reviewers,marco DONTBUILD

Comment 5

[Silaghi Andreea]

https://hg.mozilla.org/mozilla-central/rev/d93ff2fe8e68

Comment 6

[Silaghi Andreea]

There are still mozlint failures here https://treeherder.mozilla.org/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&searchStr=mozlint&selectedTaskRun=KOOvLM1CSGePro26Fwwr5g.0
@slederu can you please check? Thank you.

Comment 7

[Intermittent Failures Robot]

26 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 6

Table

	no_variant
linux2404-x86_64/opt	9
macosx1470-x86_64/opt	9
windows11-x86_64/opt	8

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-03-17&endday=2026-03-17&tree=all

Comment 8

[Intermittent Failures Robot]

81 failures were associated with this bug in the last 7 days.
This is the #50 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• autoland: 57
• mozilla-central: 24

Table

	msix	no_variant
linux2404-x86_64/opt		34
macosx1470-x86_64/opt		22
windows11-x86/opt		2
windows11-x86_64/opt	2	21

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-03-16&endday=2026-03-22&tree=all

Comment 9

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 2023756 - Replace shared mutable state in codespell linter with instance variables r?#linter-reviewers

Comment 10

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 2023756 - Replace shared mutable state in codespell linter with instance variables r?#linter-reviewers

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/9cd84381ad0a
https://hg.mozilla.org/integration/autoland/rev/69e4edf6e342
Replace shared mutable state in codespell linter with instance variables r=linter-reviewers,ahal DONTBUILD

Comment 12

[Intermittent Failures Robot]

15 failures were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 3
• autoland: 9
• mozilla-central: 3

Table

	no_variant
linux2404-x86_64/opt	5
macosx1470-x86_64/opt	5
windows11-x86_64/opt	5

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-03-24&endday=2026-03-24&tree=all

Comment 13

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/69e4edf6e342

Comment 14

[Intermittent Failures Robot]

18 failures were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-beta: 3
• autoland: 9
• mozilla-central: 3

Table

	no_variant
linux2404-x86_64/opt	6
macosx1470-x86_64/opt	6
windows11-x86_64/opt	6

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-03-23&endday=2026-03-29&tree=all

Comment 15

[Mark Banner (:standard8)]

Clearing obsolete NI from the original regression notice.

Comment 16

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:Sylvestre, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
  • See https://wiki.mozilla.org/Release_Management/Requesting_an_Uplift for documentation on how to request an uplift.
• If no, please set status-firefox150 to wontfix.

For more information, please visit BugBot documentation.

Comment 17

[Intermittent Failures Robot]

4 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Table

	no_variant
linux2404-x86_64/opt	1
macosx1470-x86_64/opt	2
windows11-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=2023756&startday=2026-04-13&endday=2026-04-19&tree=all