Closed Bug 1761992 Opened 3 years ago Closed 3 years ago

glean error with `moz-phab submit .`

Categories

(Conduit :: moz-phab, defect)

Production
defect

Tracking

(Not tracked)

RESOLVED WORKSFORME

People

(Reporter: jmaher, Unassigned)

References

Details

I run windows 11, and have been successful in the past at submitting patches to phabricator. Last week I upgraded to mozilla-build 4.0 and after an hour or so things have been working. I am not sure if I have done a phabricator submissions since then (no idea how to find a history of what I have uploaded).

but today I am not able to submit and I get this:

 moz-phab submit .
Traceback (most recent call last):
  File "c:\mozilla-build\python3\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\mozilla-build\python3\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\mozilla-build\python3\Scripts\moz-phab.exe\__main__.py", line 4, in <module>
  File "c:\mozilla-build\python3\lib\site-packages\mozphab\mozphab.py", line 20, in <module>
    from .args import parse_args
  File "c:\mozilla-build\python3\lib\site-packages\mozphab\args.py", line 14, in <module>
    from .detect_repository import find_repo_root
  File "c:\mozilla-build\python3\lib\site-packages\mozphab\detect_repository.py", line 8, in <module>
    from .git import Git
  File "c:\mozilla-build\python3\lib\site-packages\mozphab\git.py", line 30, in <module>
    from .telemetry import telemetry
  File "c:\mozilla-build\python3\lib\site-packages\mozphab\telemetry.py", line 9, in <module>
    from glean import Glean, Configuration, load_metrics, load_pings
  File "c:\mozilla-build\python3\lib\site-packages\glean\__init__.py", line 17, in <module>
    from .glean import Glean
  File "c:\mozilla-build\python3\lib\site-packages\glean\glean.py", line 22, in <module>
    from .config import Configuration
  File "c:\mozilla-build\python3\lib\site-packages\glean\config.py", line 13, in <module>
    from . import net
  File "c:\mozilla-build\python3\lib\site-packages\glean\net\__init__.py", line 14, in <module>
    from .ping_upload_worker import PingUploadWorker
  File "c:\mozilla-build\python3\lib\site-packages\glean\net\ping_upload_worker.py", line 14, in <module>
    from .upload_task_tag import UploadTaskTag
  File "c:\mozilla-build\python3\lib\site-packages\glean\net\upload_task_tag.py", line 8, in <module>
    from .. import _ffi
  File "c:\mozilla-build\python3\lib\site-packages\glean\_ffi.py", line 14, in <module>
    from ._glean_ffi import ffi  # type: ignore
  File "c:\mozilla-build\python3\lib\site-packages\glean\_glean_ffi.py", line 2, in <module>
    import _cffi_backend
ModuleNotFoundError: No module named '_cffi_backend'

I am on the tip of mozilla-central, I assume that doesn't matter. I also tried a ./mach bootstrap and get the same error.

Interesting, I bet this is related to Python environment shenanigans.
Can you share the following command output for me?

which moz-phab
pip3 list -v
Flags: needinfo?(jmaher)
elvis@DESKTOP-35QKDMP ~/mozilla-central
$ which moz-phab
/c/mozilla-build/python3/Scripts/moz-phab

elvis@DESKTOP-35QKDMP ~/mozilla-central
$ pip3 list -v
Package                       Version    Editable project location                  Location                                                                      Installer
----------------------------- ---------- ------------------------------------------ ----------------------------------------------------------------------------- ---------
adr                           0.19.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
aiocontextvars                0.2.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
aiohttp                       3.8.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
aiosignal                     1.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
alabaster                     0.7.12                                                c:\mozilla-build\python3\lib\site-packages                                    pip
appdirs                       1.4.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
arsenic                       19.1                                                  c:\mozilla-build\python3\lib\site-packages                                    pip
async-timeout                 4.0.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
asynctest                     0.13.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
atomicwrites                  1.4.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
attr                          0.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
attrs                         21.2.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
avro                          1.9.0                                                 c:\mozilla-build\python3\lib\site-packages
Babel                         2.8.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
black                         21.12b0                                               c:\mozilla-build\python3\lib\site-packages                                    pip
blessings                     1.7                                                   c:\mozilla-build\python3\lib\site-packages                                    pip
boto3                         1.14.51                                               c:\mozilla-build\python3\lib\site-packages                                    pip
botocore                      1.17.51                                               c:\mozilla-build\python3\lib\site-packages                                    pip
CacheControl                  0.12.5                                                c:\mozilla-build\python3\lib\site-packages
cachetools                    3.1.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
cachy                         0.3.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
certifi                       2020.6.20                                             c:\mozilla-build\python3\lib\site-packages                                    pip
cffi                          1.14.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
cfgv                          3.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
chardet                       3.0.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
charset-normalizer            2.0.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
ci-admin                      1.0.0      c:\users\elvis\ci-admin\src                c:\users\elvis\ci-admin\src
cleo                          0.8.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
click                         7.1.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
clikit                        0.6.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
colorama                      0.4.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
contextvars                   2.4                                                   c:\mozilla-build\python3\lib\site-packages
coverage                      6.0b1                                                 c:\mozilla-build\python3\lib\site-packages\coverage-6.0b1-py3.7-win-amd64.egg
crashtest                     0.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
cycler                        0.10.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
dataclasses                   0.7                                                   c:\mozilla-build\python3\lib\site-packages                                    pip
diskcache                     5.2.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
distlib                       0.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
distro                        1.5.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
docutils                      0.15.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
filelock                      3.0.12                                                c:\mozilla-build\python3\lib\site-packages                                    pip
flake8                        3.8.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
frozenlist                    1.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
glean                         1.18.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
glean-parser                  2.5.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
glean-sdk                     36.0.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
google-api-python-client      1.7.8                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
google-auth                   1.6.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
google-auth-httplib2          0.0.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
html5lib                      1.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
httplib2                      0.12.1                                                c:\mozilla-build\python3\lib\site-packages
identify                      1.4.25                                                c:\mozilla-build\python3\lib\site-packages                                    pip
idna                          2.10                                                  c:\mozilla-build\python3\lib\site-packages                                    pip
idna-ssl                      1.1.0                                                 c:\mozilla-build\python3\lib\site-packages
imagesize                     1.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
immutables                    0.11                                                  c:\mozilla-build\python3\lib\site-packages                                    pip
importlib-metadata            1.7.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
iniconfig                     1.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
iso8601                       0.1.12                                                c:\mozilla-build\python3\lib\site-packages                                    pip
Jinja2                        2.11.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
jmespath                      0.10.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
joblib                        0.13.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
json-e                        3.0.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
jsonschema                    3.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
keyring                       21.8.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
kiwisolver                    1.1.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
lockfile                      0.12.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
loguru                        0.5.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
lru-dict                      1.1.7                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
manifestparser                2.1.0      c:\mozilla-build\python3\lib\site-packages c:\mozilla-build\python3\lib\site-packages                                    pip
Markdown                      3.2.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
markdown2                     2.4.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
MarkupSafe                    1.1.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
matplotlib                    3.1.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
memoized                      0.3                                                   c:\mozilla-build\python3\lib\site-packages
mercurial                     6.1                                                   c:\mozilla-build\python3\lib\site-packages                                    pip
mock                          4.0.3                                                 c:\mozilla-build\python3\lib\site-packages\mock-4.0.3-py3.7.egg
mohawk                        1.1.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
more-itertools                8.4.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
moz-phab                      0.0.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
mozci                         1.12.6                                                c:\mozilla-build\python3\lib\site-packages                                    pip
mozfile                       2.1.0      c:\mozilla-build\python3\lib\site-packages c:\mozilla-build\python3\lib\site-packages                                    pip
mozinfo                       1.2.2      c:\mozilla-build\python3\lib\site-packages c:\mozilla-build\python3\lib\site-packages                                    pip
mozlog                        7.1.0      c:\mozilla-build\python3\lib\site-packages c:\mozilla-build\python3\lib\site-packages                                    pip
MozPhab                       0.1.99                                                c:\mozilla-build\python3\lib\site-packages                                    pip
mozterm                       1.0.0                                                 c:\mozilla-build\python3\lib\site-packages\mozterm-1.0.0-py3.7.egg
msgpack                       0.6.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
multidict                     4.7.6                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
mypy-extensions               0.4.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
nodeenv                       1.4.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
nose                          1.3.7                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
numpy                         1.20.3                                                c:\mozilla-build\python3\lib\site-packages                                    pip
oauth2client                  4.1.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
packaging                     20.4                                                  c:\mozilla-build\python3\lib\site-packages                                    pip
pandas                        0.25.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
pastel                        0.2.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pathspec                      0.9.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
patsy                         0.5.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pep517                        0.12.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
pexpect                       4.8.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pip                           22.0.4                                                c:\mozilla-build\python3\lib\site-packages                                    pip
pip-tools                     6.4.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pkginfo                       1.5.0.1                                               c:\mozilla-build\python3\lib\site-packages                                    pip
platformdirs                  2.4.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pluggy                        0.13.1                                                c:\mozilla-build\python3\lib\site-packages                                    pip
poetry                        1.1.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
poetry-core                   1.0.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pre-commit                    2.16.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
psutil                        5.8.0                                                 c:\mozilla-build\python3\lib\site-packages\psutil-5.8.0-py3.7-win-amd64.egg
ptyprocess                    0.7.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
py                            1.9.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pyasn1                        0.4.5                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pyasn1-modules                0.2.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pycodestyle                   2.6.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pycparser                     2.20                                                  c:\mozilla-build\python3\lib\site-packages                                    pip
pyflakes                      2.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
Pygments                      2.6.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pylev                         1.3.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pyparsing                     2.4.7                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pyrsistent                    0.14.11                                               c:\mozilla-build\python3\lib\site-packages
pytest                        6.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
pytest-asyncio                0.14.0                                                c:\mozilla-build\python3\lib\site-packages\pytest_asyncio-0.14.0-py3.6.egg
python-bugzilla               3.1.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
python-dateutil               2.8.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
python-hglib                  2.6.1                                                 c:\mozilla-build\python3\lib\site-packages
python3-memcached             1.51                                                  c:\mozilla-build\python3\lib\site-packages
pytz                          2020.1                                                c:\mozilla-build\python3\lib\site-packages                                    pip
pywin32-ctypes                0.2.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
PyYAML                        5.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
redis                         3.5.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
redo                          2.0.4                                                 c:\mozilla-build\python3\lib\site-packages\redo-2.0.4-py3.7.egg
regex                         2020.11.13                                            c:\mozilla-build\python3\lib\site-packages                                    pip
requests                      2.24.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
requests-toolbelt             0.9.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
responses                     0.12.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
rsa                           4.0                                                   c:\mozilla-build\python3\lib\site-packages                                    pip
rtoml                         0.7.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
s3transfer                    0.3.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
scikit-learn                  0.21.3                                                c:\mozilla-build\python3\lib\site-packages                                    pip
scipy                         1.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sentry-sdk                    0.14.3                                                c:\mozilla-build\python3\lib\site-packages                                    pip
setuptools                    60.9.3                                                c:\mozilla-build\python3\lib\site-packages                                    pip
shellingham                   1.3.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
simplejson                    3.17.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
six                           1.15.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
sklearn                       0.0                                                   c:\mozilla-build\python3\lib\site-packages
slugid                        2.0.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
snowballstemmer               2.0.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sortedcontainers              2.3.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
Sphinx                        3.2.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-applehelp       1.0.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-devhelp         1.0.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-htmlhelp        1.0.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-jsmath          1.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-qthelp          1.0.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
sphinxcontrib-serializinghtml 1.1.4                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
statsmodels                   0.10.1                                                c:\mozilla-build\python3\lib\site-packages                                    pip
structlog                     21.5.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
taskcluster                   44.2.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
taskcluster-urls              13.0.1                                                c:\mozilla-build\python3\lib\site-packages                                    pip
terminaltables                3.1.0                                                 c:\mozilla-build\python3\lib\site-packages
toml                          0.10.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
tomli                         1.2.3                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
tomlkit                       0.8.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
tox                           3.19.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
treeherder-client             5.0.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
typed-ast                     1.4.2                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
typing_extensions             4.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
uritemplate                   3.0.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
urllib3                       1.25.7                                                c:\mozilla-build\python3\lib\site-packages                                    pip
ValidX                        0.7                                                   c:\mozilla-build\python3\lib\site-packages                                    pip
virtualenv                    20.0.30                                               c:\mozilla-build\python3\lib\site-packages                                    pip
voluptuous                    0.11.7                                                c:\mozilla-build\python3\lib\site-packages                                    pip
webencodings                  0.5.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
wheel                         0.36.2                                                c:\mozilla-build\python3\lib\site-packages                                    pip
win32-setctime                1.0.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
windows-curses                2.3.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
yamllint                      1.26.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
yarl                          1.5.1                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
zipp                          3.4.0                                                 c:\mozilla-build\python3\lib\site-packages                                    pip
zstandard                     0.14.0                                                c:\mozilla-build\python3\lib\site-packages                                    pip
Flags: needinfo?(jmaher)

Hmm, that all looks pretty good to me.
One more question: when you installed MozillaBuild 4.0, did you fully delete MozillaBuild 3.4 (C:\mozilla-build) beforehand?

Anyways, to resolve this, try pip3 install --ignore-installed mozphab. Let me know if that works :)

Flags: needinfo?(jmaher)

thank you, the command pip3 install --ignore-installed mozphab allowed me to submit to phabricator again!

As to your question about uninstalling, I did not, I just installed and it said it would overwrite things in c:\mozilla-build, so I let it go.

Flags: needinfo?(jmaher)

As to your question about uninstalling, I did not, I just installed and it said it would overwrite things in c:\mozilla-build, so I let it go.

Ah, that was probably the source of our issue - "pave-over installs" aren't super well supported, so I'd highly recommend fully deleting the old directory when upgrading your MozillaBuild.
(I'd probably still recommend doing it in this case, as other tools may still misbehave due to leftover files).

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → WORKSFORME
See Also: → 1762016
See Also: → 1761444
You need to log in before you can comment on or make changes to this bug.