1700757 - Perma [tier 2] mpu test_visualmetrics.py Exception: Could not find any files in this configuration: [] | [taskcluster:error] exit status 1

Status: RESOLVED FIXED

(Testing :: mozperftest, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=334324745&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WMIN3xJeShC_Ca1SDmd2RQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-03-24T19:13:07.402Z] Installing collected packages: mozproxy
[task 2021-03-24T19:13:07.402Z]   Attempting uninstall: mozproxy
[task 2021-03-24T19:13:07.402Z]     Found existing installation: mozproxy 1.0
[task 2021-03-24T19:13:07.402Z]     Uninstalling mozproxy-1.0:
[task 2021-03-24T19:13:07.402Z]       Successfully uninstalled mozproxy-1.0
[task 2021-03-24T19:13:07.402Z] Successfully installed mozproxy-1.0
[task 2021-03-24T19:13:07.402Z] WARNING: You are using pip version 20.3.1; however, version 21.0.1 is available.
[task 2021-03-24T19:13:07.402Z] You should consider upgrading via the '/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init_py3/bin/python -m pip install --upgrade pip' command.
[task 2021-03-24T19:13:07.402Z] ..                        
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_runner.py .                          
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_script.py ........                   
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_single_json_transformer.py ...       
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_transformer.py ..........            
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_utils.py .....
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] ........               
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_visualmetrics.py F
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] =================================== FAILURES ===================================
[task 2021-03-24T19:13:07.402Z] _____________________________ test_visual_metrics ______________________________
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] device = <MagicMock name='install_package' id='140677860153552'>
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z]     @mock.patch("mozperftest.test.browsertime.runner.install_package")
[task 2021-03-24T19:13:07.402Z]     @mock.patch(
[task 2021-03-24T19:13:07.402Z]         "mozperftest.test.noderunner.NodeRunner.verify_node_install", new=lambda x: True
[task 2021-03-24T19:13:07.402Z]     )
[task 2021-03-24T19:13:07.402Z]     @mock.patch(
[task 2021-03-24T19:13:07.402Z]         "mozperftest.test.browsertime.runner.BrowsertimeRunner._setup_node_packages",
[task 2021-03-24T19:13:07.402Z]         new=lambda x, y: None,
[task 2021-03-24T19:13:07.402Z]     )
[task 2021-03-24T19:13:07.402Z]     @mock.patch("mozperftest.metrics.visualmetrics.which", new=lambda path: "ok")
[task 2021-03-24T19:13:07.402Z]     @mock.patch("mozbuild.nodeutil.find_node_executable", new=mocked_executable)
[task 2021-03-24T19:13:07.402Z]     @mock.patch("subprocess.check_output", new=get_res)
[task 2021-03-24T19:13:07.402Z]     def test_visual_metrics(device):
[task 2021-03-24T19:13:07.402Z]         os.environ["VISUALMETRICS_PY"] = ""
[task 2021-03-24T19:13:07.402Z]         mach_cmd, metadata, env = get_running_env(
[task 2021-03-24T19:13:07.402Z]             visualmetrics=True,
[task 2021-03-24T19:13:07.402Z]             perfherder=True,
[task 2021-03-24T19:13:07.402Z]             verbose=True,
[task 2021-03-24T19:13:07.402Z]             tests=[EXAMPLE_TEST],
[task 2021-03-24T19:13:07.402Z]         )
[task 2021-03-24T19:13:07.402Z]         metrics = env.layers[METRICS]
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]         metadata.add_result({"results": str(BT_DATA_VIDEO.parent), "name": "browsertime"})
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]         with temp_file() as output:
[task 2021-03-24T19:13:07.402Z]             env.set_arg("output", output)
[task 2021-03-24T19:13:07.402Z]             with metrics as m:
[task 2021-03-24T19:13:07.402Z] >               metadata = m(metadata)
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/tests/test_visualmetrics.py:64: 
[task 2021-03-24T19:13:07.402Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/layers.py:156: in __call__
[task 2021-03-24T19:13:07.402Z]     metadata = layer(metadata)
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/layers.py:68: in __call__
[task 2021-03-24T19:13:07.402Z]     metadata = self.run(metadata)
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/perfherder.py:102: in run
[task 2021-03-24T19:13:07.402Z]     simplify_exclude=self.get_arg("simplify-exclude"),
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/common.py:336: in filtered_metrics
[task 2021-03-24T19:13:07.402Z]     simplify_exclude=simplify_exclude,
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/common.py:216: in filtered_metrics
[task 2021-03-24T19:13:07.402Z]     group_name=group_name, transformer=transformer
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/common.py:183: in get_standardized_data
[task 2021-03-24T19:13:07.402Z]     r = ptnb.process(**data_info["options"])
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/notebook/perftestetl.py:143: in process
[task 2021-03-24T19:13:07.402Z]     files = self.parse_file_grouping(files)
[task 2021-03-24T19:13:07.402Z] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] self = <mozperftest.metrics.notebook.perftestetl.PerftestETL object at 0x7ff2287cb2e8>
[task 2021-03-24T19:13:07.402Z] file_grouping = []
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z]     def parse_file_grouping(self, file_grouping):
[task 2021-03-24T19:13:07.402Z]         """Handles differences in the file_grouping definitions.
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]             It can either be a path to a folder containing the files, a list of files,
[task 2021-03-24T19:13:07.402Z]             or it can contain settings from an artifact_downloader instance.
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]             :param file_grouping: A file grouping entry.
[task 2021-03-24T19:13:07.402Z]             :return: A list of files to process.
[task 2021-03-24T19:13:07.402Z]             """
[task 2021-03-24T19:13:07.402Z]         files = []
[task 2021-03-24T19:13:07.402Z]         if isinstance(file_grouping, list):
[task 2021-03-24T19:13:07.402Z]             # A list of files was provided
[task 2021-03-24T19:13:07.402Z]             files = file_grouping
[task 2021-03-24T19:13:07.402Z]         elif isinstance(file_grouping, dict):
[task 2021-03-24T19:13:07.402Z]             # A dictionary of settings from an artifact_downloader instance
[task 2021-03-24T19:13:07.402Z]             # was provided here
[task 2021-03-24T19:13:07.402Z]             raise Exception(
[task 2021-03-24T19:13:07.402Z]                 "Artifact downloader tooling is disabled for the time being."
[task 2021-03-24T19:13:07.402Z]             )
[task 2021-03-24T19:13:07.402Z]         elif isinstance(file_grouping, str):
[task 2021-03-24T19:13:07.402Z]             # Assume a path to files was given
[task 2021-03-24T19:13:07.402Z]             filepath = file_grouping
[task 2021-03-24T19:13:07.402Z]             newf = [f.resolve().as_posix() for f in pathlib.Path(filepath).rglob("*")]
[task 2021-03-24T19:13:07.402Z]             files = newf
[task 2021-03-24T19:13:07.402Z]         else:
[task 2021-03-24T19:13:07.402Z]             raise Exception(
[task 2021-03-24T19:13:07.402Z]                 "Unknown file grouping type provided here: %s" % file_grouping
[task 2021-03-24T19:13:07.402Z]             )
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]         if self.sort_files:
[task 2021-03-24T19:13:07.402Z]             if isinstance(files, list):
[task 2021-03-24T19:13:07.402Z]                 files.sort()
[task 2021-03-24T19:13:07.402Z]             else:
[task 2021-03-24T19:13:07.402Z]                 for _, file_list in files.items():
[task 2021-03-24T19:13:07.402Z]                     file_list.sort()
[task 2021-03-24T19:13:07.402Z]                 files = OrderedDict(sorted(files.items(), key=lambda entry: entry[0]))
[task 2021-03-24T19:13:07.402Z]     
[task 2021-03-24T19:13:07.402Z]         if not files:
[task 2021-03-24T19:13:07.402Z]             raise Exception(
[task 2021-03-24T19:13:07.402Z] >               "Could not find any files in this configuration: %s" % file_grouping
[task 2021-03-24T19:13:07.402Z]             )
[task 2021-03-24T19:13:07.402Z] E           Exception: Could not find any files in this configuration: []
[task 2021-03-24T19:13:07.402Z] 
[task 2021-03-24T19:13:07.402Z] python/mozperftest/mozperftest/metrics/notebook/perftestetl.py:116: Exception
[task 2021-03-24T19:13:07.402Z] ========================== slowest 10 test durations ===========================
[task 2021-03-24T19:13:07.402Z] 4.31s call     mozperftest/tests/test_proxy.py::test_replay
[task 2021-03-24T19:13:07.402Z] 4.12s call     mozperftest/tests/test_influx.py::test_influx_service[True]
[task 2021-03-24T19:13:07.403Z] 3.39s call     mozperftest/tests/test_proxy.py::test_record
[task 2021-03-24T19:13:07.403Z] 3.27s call     mozperftest/tests/test_proxy.py::test_replay_url
[task 2021-03-24T19:13:07.403Z] 2.80s call     mozperftest/tests/test_pingserver.py::test_ping_server
[task 2021-03-24T19:13:07.403Z] 0.71s call     mozperftest/tests/test_influx.py::test_influx_service[False]
[task 2021-03-24T19:13:07.403Z] 0.36s call     mozperftest/tests/test_notebookupload.py::test_compare_to_success[True]
[task 2021-03-24T19:13:07.403Z] 0.36s call     mozperftest/tests/test_notebookupload.py::test_compare_to_success[False]
[task 2021-03-24T19:13:07.403Z] 0.28s call     mozperftest/tests/test_perfherder.py::test_perfherder_simple_names
[task 2021-03-24T19:13:07.403Z] 0.25s call     mozperftest/tests/test_perfherder.py::test_perfherder_validation_failure
[task 2021-03-24T19:13:07.403Z] ==================== 1 failed, 157 passed in 25.84 seconds =====================
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] [FAILED]
[task 2021-03-24T19:13:07.403Z] Error running mach:
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z]     ['perftest-test']
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] The error occurred in the implementation of the invoked mach command.
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] This should never occur and is likely a bug in the implementation of that
[task 2021-03-24T19:13:07.403Z] command.
[task 2021-03-24T19:13:07.403Z] You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2021-03-24T19:13:07.403Z] isn't, please use |./mach busted file perftest-test| to report it. If |./mach busted| is
[task 2021-03-24T19:13:07.403Z] misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] If filing a bug, please include the full output of mach, including this error
[task 2021-03-24T19:13:07.403Z] message.
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] The details of the failure are as follows:
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z] AssertionError
[task 2021-03-24T19:13:07.403Z] 
[task 2021-03-24T19:13:07.403Z]   File "/builds/worker/checkouts/gecko/python/mozperftest/mozperftest/mach_commands.py", line 197, in run_tests
[task 2021-03-24T19:13:07.403Z]     self._run_tests(**kwargs)
[task 2021-03-24T19:13:07.403Z]   File "/builds/worker/checkouts/gecko/python/mozperftest/mozperftest/mach_commands.py", line 282, in _run_tests
[task 2021-03-24T19:13:07.403Z]     venv, "coverage", args, label="running tests", verbose=verbose
[taskcluster 2021-03-24 19:13:07.894Z] === Task Finished ===
[taskcluster 2021-03-24 19:13:07.894Z] Unsuccessful task run with exit code: 1 completed in 539.676 seconds```

Comment 1

[Alexandru Michis [:malexandru]]

Fixed by backing out Bug 1697844.
Backout link: https://hg.mozilla.org/integration/autoland/rev/7e4faff5646b87f436bd6167fafc670fb1b24acf

Comment 2

[Intermittent Failures Robot]

3 failures in 3967 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• linux1804-64: 1
  • opt: 1
• windows10-64: 1
  • opt: 1
• macosx1014-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1700757&startday=2021-03-22&endday=2021-03-28&tree=all