1652286 - Intermittent mach.base.MachError: Mach command 'cmd_foo' implemented incorrectly. Conditions argument must take a list of functions. Found <class 'str'> instead.

Status: RESOLVED FIXED

(Firefox Build System :: General, defect, P5)

Description

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=309461260&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DW_cmZdsTdOuqg3apMXSTA/runs/0/artifacts/public/logs/live_backing.log

 [task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:123: WARNING: duplicate label automated tests, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/devtools/tests/README.md
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:140: WARNING: duplicate label further reading, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/contributing/vcs/mercurial.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:230: WARNING: duplicate label further reading, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:306: WARNING: duplicate label experiments, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/search/SearchConfigurationSchema.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:391: WARNING: duplicate label further reading, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/experiments.rst:553: WARNING: duplicate label telemetry, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/urlbar/telemetry.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/hybrid-content.rst:335: WARNING: duplicate label testing, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/contributing/directory_structure.rst
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/hybrid-content.rst:343: WARNING: duplicate label manual testing, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/devtools/contributing/code-reviews-checklist.md
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/hybrid-content.rst:360: WARNING: duplicate label automated testing, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/devtools/contributing/code-reviews-checklist.md
[task 2020-07-11T22:02:01.710Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/hybrid-content.rst:371: WARNING: duplicate label version history, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/optout-ping.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/remote/PuppeteerVendor.md:1: WARNING: duplicate label vendoring puppeteer, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/remote/doc/remote/ppeteerVendor.md
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozbuild.compilation.rst:5: WARNING: duplicate label submodules, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozpack.chrome.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozbuild.compilation.rst:41: WARNING: duplicate label module contents, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozpack.chrome.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/js/Debugger/index.rst:3: WARNING: duplicate label debugger api, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/devtools/backend/debugger-api.md
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/mozbase/mozpower.rst:68: WARNING: duplicate label mozpower, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/mozbase/mozpower.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/taskcluster/balrog.rst:5: WARNING: duplicate label overview, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/browser/components/newtab/docs/v2-system-addon/unit_testing_guide.md
[task 2020-07-11T22:02:01.711Z] WARNING: autodoc: failed to import module 'conditions_invalid' from module 'mach.test.providers'; the following exception was raised:
[task 2020-07-11T22:02:01.711Z] Traceback (most recent call last):
[task 2020-07-11T22:02:01.711Z]   File "/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/moztreedocs-A8BSWbM4/lib/python3.6/site-packages/sphinx/ext/autodoc/importer.py", line 32, in import_module
[task 2020-07-11T22:02:01.711Z]     return importlib.import_module(modname)
[task 2020-07-11T22:02:01.711Z]   File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
[task 2020-07-11T22:02:01.711Z]     return _bootstrap._gcd_import(name[level:], package, level)
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
[task 2020-07-11T22:02:01.711Z]   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
[task 2020-07-11T22:02:01.711Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/test/providers/conditions_invalid.py", line 15, in <module>
[task 2020-07-11T22:02:01.711Z]     class ConditionsProvider(object):
[task 2020-07-11T22:02:01.711Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/decorators.py", line 169, in CommandProvider
[task 2020-07-11T22:02:01.711Z]     raise MachError(msg)
[task 2020-07-11T22:02:01.711Z] mach.base.MachError: Mach command 'cmd_foo' implemented incorrectly. Conditions argument must take a list of functions. Found <class 'str'> instead.
[task 2020-07-11T22:02:01.711Z] 
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mach.test.providers.rst:5: WARNING: duplicate label submodules, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozbuild.compilation.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mach.test.providers.rst:57: WARNING: duplicate label module contents, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/python/mozbuild.compilation.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/tools/sanitizer/asan_nightly.rst:34: WARNING: duplicate label requirements, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/tools/sanitizer/asan_nightly.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/tools/sanitizer/asan_nightly.rst:66: WARNING: duplicate label preferences, other instance in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/docs/html/_staging/toolkit/components/telemetry/obsolete/fhr/architecture.rst
[task 2020-07-11T22:02:01.711Z] /builds/worker/checkouts/gecko/python/mach/mach/mixin/logging.py:docstring of mach.mixin.logging.LoggingMixin.log:20: WARNING: Unexpected section title.

Comment 1

[Intermittent Failures Robot]

3 failures in 5265 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform breakdown:

• doc: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1652286&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Sylvestre, please check what the actual error is here. There are many different error lines for the successful doc(upload) tasks which renders it time intensive to find the correct error line.

Comment 3

[Sylvestre Ledru [:Sylvestre]]

I guess it is caused by bug 1643293
emil, does it ring a bell?

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1643293

Comment 5

[Intermittent Failures Robot]

2 failures in 4014 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-central: 1

Platform breakdown:

• doc: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1652286&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 6

[Intermittent Failures Robot]

3 failures in 4310 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• doc: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1652286&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 4289 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• doc: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1652286&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 9

[Sylvestre Ledru [:Sylvestre]]

Attachment: Bug 1652286 - Firefox doc: Workaround the BlockingIOError error r?#firefox-source-docs-reviewers

Comment 10

[Sylvestre Ledru [:Sylvestre]]

Moving to sequential seems to work:

Maybe it is caused by autodoc?

ask 2020-08-22T17:31:46.069Z] WARNING: autodoc: failed to import module 'invoke_mach_command' from module 'mach.test'; the following exception was raised:
[task 2020-08-22T17:31:46.069Z] Traceback (most recent call last):
[task 2020-08-22T17:31:46.069Z]   File "/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/docs/lib/python3.6/site-packages/sphinx/ext/autodoc/importer.py", line 32, in import_module
[task 2020-08-22T17:31:46.069Z]     return importlib.import_module(modname)
[task 2020-08-22T17:31:46.069Z]   File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
[task 2020-08-22T17:31:46.069Z]     return _bootstrap._gcd_import(name[level:], package, level)
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
[task 2020-08-22T17:31:46.069Z]   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
[task 2020-08-22T17:31:46.069Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/test/invoke_mach_command.py", line 5, in <module>
[task 2020-08-22T17:31:46.069Z]     subprocess.check_call([sys.executable] + sys.argv[1:])
[task 2020-08-22T17:31:46.069Z]   File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
[task 2020-08-22T17:31:46.069Z]     raise CalledProcessError(retcode, cmd)
[task 2020-08-22T17:31:46.069Z] subprocess.CalledProcessError: Command '['/usr/bin/python3', 'doc', '--verbose', '--upload', '--no-open', '--no-serve', '--write-url', '/builds/worker/firefox-source-docs-url.txt']' returned non-zero exit status 2.
[task 2020-08-22T17:31:46.070Z] 
[task 2020-08-22T17:31:46.070Z] WARNING: autodoc: failed to import module 'zero_microseconds' from module 'mach.test'; the following exception was raised:
[task 2020-08-22T17:31:46.070Z] Traceback (most recent call last):
[task 2020-08-22T17:31:46.070Z]   File "/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/docs/lib/python3.6/site-packages/sphinx/ext/autodoc/importer.py", line 32, in import_module
[task 2020-08-22T17:31:46.070Z]     return importlib.import_module(modname)
[task 2020-08-22T17:31:46.070Z]   File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
[task 2020-08-22T17:31:46.070Z]     return _bootstrap._gcd_import(name[level:], package, level)
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
[task 2020-08-22T17:31:46.070Z]   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
[task 2020-08-22T17:31:46.070Z]   File "/builds/worker/checkouts/gecko/python/mach/mach/test/zero_microseconds.py", line 4, in <module>
[task 2020-08-22T17:31:46.070Z]     old = self._mach_context.post_dispatch_handler  # noqa: F821
[task 2020-08-22T17:31:46.070Z] NameError: name 'self' is not defined

Log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=313746533&repo=try&lineNumber=124565

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5359ee1fbf49
Firefox doc: Workaround the BlockingIOError error r=firefox-source-docs-reviewers,championshuttler

Comment 12

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/5359ee1fbf49

Comment 13

[Intermittent Failures Robot]

1 failures in 4100 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• doc: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1652286&startday=2020-08-17&endday=2020-08-23&tree=all